[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 19:56:34.938760 17004 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.155.62:45939
I20240501 19:56:34.939713 17004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 19:56:34.940323 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:56:34.948055 17010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:34.948885 17009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:34.949440 17012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:56:34.950208 17004 server_base.cc:1034] running on GCE node
I20240501 19:56:34.950739 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:56:34.950870 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:56:34.950909 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593394950907 us; error 0 us; skew 500 ppm
I20240501 19:56:34.958145 17004 webserver.cc:460] Webserver started at http://127.16.155.62:46789/ using document root <none> and password file <none>
I20240501 19:56:34.958791 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:56:34.958868 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:56:34.959251 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:56:34.961024 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/master-0-root/instance:
uuid: "1d218fcb2a8546ae91d393baaec706e7"
format_stamp: "Formatted at 2024-05-01 19:56:34 on dist-test-slave-4377"
I20240501 19:56:34.964805 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20240501 19:56:34.967145 17017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:34.968214 17004 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240501 19:56:34.968326 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/master-0-root
uuid: "1d218fcb2a8546ae91d393baaec706e7"
format_stamp: "Formatted at 2024-05-01 19:56:34 on dist-test-slave-4377"
I20240501 19:56:34.968415 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:56:34.987599 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:56:34.988181 17004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 19:56:34.988345 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:56:34.995232 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.62:45939
I20240501 19:56:34.995241 17069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.62:45939 every 8 connection(s)
I20240501 19:56:34.998387 17070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.004418 17070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: Bootstrap starting.
I20240501 19:56:35.007122 17070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.007973 17070 log.cc:824] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: Log is configured to *not* fsync() on all Append() calls
I20240501 19:56:35.009653 17070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: No bootstrap required, opened a new log
I20240501 19:56:35.012506 17070 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER }
I20240501 19:56:35.012661 17070 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.012697 17070 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d218fcb2a8546ae91d393baaec706e7, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.013223 17070 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER }
I20240501 19:56:35.013365 17070 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 19:56:35.013435 17070 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 19:56:35.013576 17070 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.014354 17070 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER }
I20240501 19:56:35.014716 17070 leader_election.cc:302] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d218fcb2a8546ae91d393baaec706e7; no voters:
I20240501 19:56:35.015005 17070 leader_election.cc:288] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 19:56:35.015120 17073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.015383 17073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 1 LEADER]: Becoming Leader. State: Replica: 1d218fcb2a8546ae91d393baaec706e7, State: Running, Role: LEADER
I20240501 19:56:35.015748 17073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER }
I20240501 19:56:35.016108 17070 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 19:56:35.017457 17075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d218fcb2a8546ae91d393baaec706e7. Latest consensus state: current_term: 1 leader_uuid: "1d218fcb2a8546ae91d393baaec706e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER } }
I20240501 19:56:35.017509 17074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d218fcb2a8546ae91d393baaec706e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d218fcb2a8546ae91d393baaec706e7" member_type: VOTER } }
I20240501 19:56:35.017637 17075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [sys.catalog]: This master's current role is: LEADER
I20240501 19:56:35.017640 17074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [sys.catalog]: This master's current role is: LEADER
I20240501 19:56:35.017994 17082 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 19:56:35.021308 17082 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 19:56:35.021608 17004 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 19:56:35.027294 17082 catalog_manager.cc:1347] Generated new cluster ID: ca5263d00d94422091fc2c703c90333c
I20240501 19:56:35.027375 17082 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 19:56:35.044998 17082 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 19:56:35.046257 17082 catalog_manager.cc:1504] Loading token signing keys...
I20240501 19:56:35.053180 17082 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: Generated new TSK 0
I20240501 19:56:35.054006 17082 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 19:56:35.086335 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:56:35.089671 17095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:35.090471 17093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:35.090953 17092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:56:35.091729 17004 server_base.cc:1034] running on GCE node
I20240501 19:56:35.091996 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:56:35.092056 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:56:35.092079 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593395092079 us; error 0 us; skew 500 ppm
I20240501 19:56:35.093169 17004 webserver.cc:460] Webserver started at http://127.16.155.1:40131/ using document root <none> and password file <none>
I20240501 19:56:35.093322 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:56:35.093374 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:56:35.093453 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:56:35.093866 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-0-root/instance:
uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.095293 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20240501 19:56:35.096166 17100 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.096383 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 19:56:35.096443 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.096510 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:56:35.106156 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:56:35.106551 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:56:35.107003 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:56:35.107712 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:56:35.107764 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.107807 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:56:35.107839 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.114145 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.1:38099
I20240501 19:56:35.114322 17163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.1:38099 every 8 connection(s)
I20240501 19:56:35.115141 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:56:35.117717 17167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:35.118515 17170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:56:35.119307 17004 server_base.cc:1034] running on GCE node
W20240501 19:56:35.119760 17172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:56:35.120002 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:56:35.120049 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:56:35.120076 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593395120076 us; error 0 us; skew 500 ppm
I20240501 19:56:35.121587 17004 webserver.cc:460] Webserver started at http://127.16.155.2:41055/ using document root <none> and password file <none>
I20240501 19:56:35.121757 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:56:35.121805 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:56:35.121870 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:56:35.122295 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-1-root/instance:
uuid: "5d0b2e0b71014866b9e5bf08523219c1"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.124116 17165 heartbeater.cc:347] Connected to a master server at 127.16.155.62:45939
I20240501 19:56:35.124328 17165 heartbeater.cc:464] Registering TS with master...
I20240501 19:56:35.124359 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20240501 19:56:35.124770 17165 heartbeater.cc:511] Master 127.16.155.62:45939 requested a full tablet report, sending...
I20240501 19:56:35.125386 17177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.125715 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.125793 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
uuid: "5d0b2e0b71014866b9e5bf08523219c1"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.125865 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:56:35.126334 17034 ts_manager.cc:194] Registered new tserver with Master: 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099)
I20240501 19:56:35.127877 17034 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44996
I20240501 19:56:35.152762 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:56:35.153255 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:56:35.153594 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:56:35.154079 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:56:35.154121 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.154177 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:56:35.154208 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.159850 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.2:35409
I20240501 19:56:35.159905 17240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.2:35409 every 8 connection(s)
I20240501 19:56:35.160991 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:56:35.163434 17244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:35.164268 17245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:56:35.164942 17247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:56:35.165613 17241 heartbeater.cc:347] Connected to a master server at 127.16.155.62:45939
I20240501 19:56:35.165696 17004 server_base.cc:1034] running on GCE node
I20240501 19:56:35.165716 17241 heartbeater.cc:464] Registering TS with master...
I20240501 19:56:35.165834 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:56:35.165879 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:56:35.165900 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593395165900 us; error 0 us; skew 500 ppm
I20240501 19:56:35.165940 17241 heartbeater.cc:511] Master 127.16.155.62:45939 requested a full tablet report, sending...
I20240501 19:56:35.166656 17034 ts_manager.cc:194] Registered new tserver with Master: 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.166855 17004 webserver.cc:460] Webserver started at http://127.16.155.3:39177/ using document root <none> and password file <none>
I20240501 19:56:35.166981 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:56:35.167021 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:56:35.167068 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:56:35.167346 17034 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45000
I20240501 19:56:35.167392 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-2-root/instance:
uuid: "03a2099a78634ff88c9829d363aa9158"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.168881 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:56:35.169792 17252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.170053 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.170133 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
uuid: "03a2099a78634ff88c9829d363aa9158"
format_stamp: "Formatted at 2024-05-01 19:56:35 on dist-test-slave-4377"
I20240501 19:56:35.170210 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714593394928573-17004-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:56:35.181593 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:56:35.182000 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:56:35.182307 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:56:35.182776 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:56:35.182822 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.182862 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:56:35.182890 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:56:35.188654 17316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.3:33167 every 8 connection(s)
I20240501 19:56:35.188635 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.3:33167
I20240501 19:56:35.193804 17317 heartbeater.cc:347] Connected to a master server at 127.16.155.62:45939
I20240501 19:56:35.193907 17317 heartbeater.cc:464] Registering TS with master...
I20240501 19:56:35.194177 17317 heartbeater.cc:511] Master 127.16.155.62:45939 requested a full tablet report, sending...
I20240501 19:56:35.194895 17034 ts_manager.cc:194] Registered new tserver with Master: 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.194926 17004 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005729048s
I20240501 19:56:35.195438 17034 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45006
I20240501 19:56:35.195684 17004 test_util.cc:268] Using random seed: -499040480
I20240501 19:56:35.207540 17034 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45018:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 19:56:35.209174 17034 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 19:56:35.223955 17203 tablet_service.cc:1467] Processing CreateTablet for tablet 3186f38031e64525935a712c11e5af86 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 19:56:35.224427 17203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3186f38031e64525935a712c11e5af86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.224541 17277 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 19:56:35.224617 17278 tablet_service.cc:1467] Processing CreateTablet for tablet 3186f38031e64525935a712c11e5af86 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 19:56:35.224779 17277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.224798 17276 tablet_service.cc:1467] Processing CreateTablet for tablet 41693109e88f4c3994097c9faa52c5cb (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 19:56:35.225039 17276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41693109e88f4c3994097c9faa52c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.225060 17279 tablet_service.cc:1467] Processing CreateTablet for tablet e3e1da6711d4444082c8fab1f9a935a6 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 19:56:35.225268 17279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e1da6711d4444082c8fab1f9a935a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.225440 17275 tablet_service.cc:1467] Processing CreateTablet for tablet 7315b8c7084c4619b2c1cbe95f16df12 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 19:56:35.225697 17280 tablet_service.cc:1467] Processing CreateTablet for tablet 823ea1290c68453a8ae22cf2bc0d59a8 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 19:56:35.225905 17274 tablet_service.cc:1467] Processing CreateTablet for tablet b218472eb1424166a3b325d962cb28e1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 19:56:35.226317 17273 tablet_service.cc:1467] Processing CreateTablet for tablet 5c99ec29b6144dc1a569a929d5d20f9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 19:56:35.226720 17272 tablet_service.cc:1467] Processing CreateTablet for tablet a8925b1dbbc7482dafe3b15b898de0f1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 19:56:35.225701 17275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7315b8c7084c4619b2c1cbe95f16df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.227087 17205 tablet_service.cc:1467] Processing CreateTablet for tablet 823ea1290c68453a8ae22cf2bc0d59a8 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 19:56:35.227265 17205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 823ea1290c68453a8ae22cf2bc0d59a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.227689 17280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 823ea1290c68453a8ae22cf2bc0d59a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.228727 17274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b218472eb1424166a3b325d962cb28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.229007 17204 tablet_service.cc:1467] Processing CreateTablet for tablet e3e1da6711d4444082c8fab1f9a935a6 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 19:56:35.229240 17204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e1da6711d4444082c8fab1f9a935a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.229444 17278 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3186f38031e64525935a712c11e5af86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.230753 17273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c99ec29b6144dc1a569a929d5d20f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.231120 17333 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.231302 17202 tablet_service.cc:1467] Processing CreateTablet for tablet 7315b8c7084c4619b2c1cbe95f16df12 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 19:56:35.231374 17200 tablet_service.cc:1467] Processing CreateTablet for tablet 5c99ec29b6144dc1a569a929d5d20f9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 19:56:35.231532 17202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7315b8c7084c4619b2c1cbe95f16df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.231660 17200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c99ec29b6144dc1a569a929d5d20f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.231890 17201 tablet_service.cc:1467] Processing CreateTablet for tablet b218472eb1424166a3b325d962cb28e1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 19:56:35.232136 17201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b218472eb1424166a3b325d962cb28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.232568 17272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8925b1dbbc7482dafe3b15b898de0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.232719 17333 tablet_bootstrap.cc:654] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.233381 17332 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.234174 17199 tablet_service.cc:1467] Processing CreateTablet for tablet a8925b1dbbc7482dafe3b15b898de0f1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 19:56:35.234308 17332 tablet_bootstrap.cc:654] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.234433 17199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8925b1dbbc7482dafe3b15b898de0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.235484 17332 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.235571 17332 ts_tablet_manager.cc:1367] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.236037 17332 raft_consensus.cc:348] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.236150 17332 raft_consensus.cc:374] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.236189 17332 raft_consensus.cc:729] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.236328 17332 consensus_queue.cc:260] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.236445 17333 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.236519 17333 ts_tablet_manager.cc:1367] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:56:35.236733 17332 ts_tablet_manager.cc:1398] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.236918 17333 raft_consensus.cc:348] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.237066 17333 raft_consensus.cc:374] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.237092 17332 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.237102 17333 raft_consensus.cc:729] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.237103 17317 heartbeater.cc:503] Master 127.16.155.62:45939 was elected leader, sending a full tablet report...
I20240501 19:56:35.237298 17333 consensus_queue.cc:260] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.237336 17128 tablet_service.cc:1467] Processing CreateTablet for tablet 823ea1290c68453a8ae22cf2bc0d59a8 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 19:56:35.237582 17128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 823ea1290c68453a8ae22cf2bc0d59a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.237627 17333 ts_tablet_manager.cc:1398] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.237756 17241 heartbeater.cc:503] Master 127.16.155.62:45939 was elected leader, sending a full tablet report...
I20240501 19:56:35.238258 17332 tablet_bootstrap.cc:654] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.238270 17333 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.239626 17127 tablet_service.cc:1467] Processing CreateTablet for tablet e3e1da6711d4444082c8fab1f9a935a6 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 19:56:35.239949 17127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3e1da6711d4444082c8fab1f9a935a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.240180 17333 tablet_bootstrap.cc:654] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.241042 17332 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.241101 17333 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.241185 17333 ts_tablet_manager.cc:1367] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 19:56:35.241395 17339 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.241665 17333 raft_consensus.cc:348] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.241756 17333 raft_consensus.cc:374] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.241793 17333 raft_consensus.cc:729] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.241921 17333 consensus_queue.cc:260] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.242154 17333 ts_tablet_manager.cc:1398] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:56:35.242110 17126 tablet_service.cc:1467] Processing CreateTablet for tablet 3186f38031e64525935a712c11e5af86 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 19:56:35.242345 17333 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.242372 17339 tablet_bootstrap.cc:654] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.242386 17126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3186f38031e64525935a712c11e5af86. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.242604 17124 tablet_service.cc:1467] Processing CreateTablet for tablet 41693109e88f4c3994097c9faa52c5cb (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 19:56:35.242857 17124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41693109e88f4c3994097c9faa52c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.241115 17332 ts_tablet_manager.cc:1367] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:56:35.243281 17333 tablet_bootstrap.cc:654] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.243379 17332 raft_consensus.cc:348] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.243482 17332 raft_consensus.cc:374] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.243511 17332 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.243628 17332 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.243889 17332 ts_tablet_manager.cc:1398] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:56:35.244016 17332 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.244604 17332 tablet_bootstrap.cc:654] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.245200 17123 tablet_service.cc:1467] Processing CreateTablet for tablet 7315b8c7084c4619b2c1cbe95f16df12 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 19:56:35.245409 17120 tablet_service.cc:1467] Processing CreateTablet for tablet a8925b1dbbc7482dafe3b15b898de0f1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 19:56:35.245463 17123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7315b8c7084c4619b2c1cbe95f16df12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.245653 17120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8925b1dbbc7482dafe3b15b898de0f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.242398 17125 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 19:56:35.245752 17122 tablet_service.cc:1467] Processing CreateTablet for tablet b218472eb1424166a3b325d962cb28e1 (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 19:56:35.245987 17125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.246090 17121 tablet_service.cc:1467] Processing CreateTablet for tablet 5c99ec29b6144dc1a569a929d5d20f9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 19:56:35.246253 17332 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.247650 17205 tablet_service.cc:1467] Processing CreateTablet for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 19:56:35.247869 17205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a9bdc91aebe4a13acc89ce072c8cd9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.248294 17121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c99ec29b6144dc1a569a929d5d20f9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.248363 17332 ts_tablet_manager.cc:1367] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:56:35.248771 17332 raft_consensus.cc:348] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.248868 17332 raft_consensus.cc:374] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.248899 17332 raft_consensus.cc:729] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.249017 17332 consensus_queue.cc:260] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.249949 17203 tablet_service.cc:1467] Processing CreateTablet for tablet 41693109e88f4c3994097c9faa52c5cb (DEFAULT_TABLE table=test-workload [id=3c9b8970fc1f4394a44ff5a03bb13c52]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 19:56:35.250174 17203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41693109e88f4c3994097c9faa52c5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.251497 17332 ts_tablet_manager.cc:1398] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:56:35.252256 17333 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.252341 17333 ts_tablet_manager.cc:1367] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20240501 19:56:35.252377 17339 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.252439 17339 ts_tablet_manager.cc:1367] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240501 19:56:35.252754 17333 raft_consensus.cc:348] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.252789 17339 raft_consensus.cc:348] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.252856 17339 raft_consensus.cc:374] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.252869 17332 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.252883 17339 raft_consensus.cc:729] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.253063 17339 consensus_queue.cc:260] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.253219 17122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b218472eb1424166a3b325d962cb28e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:56:35.253393 17339 ts_tablet_manager.cc:1398] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.253597 17339 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.253726 17333 raft_consensus.cc:374] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.253769 17333 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.253852 17332 tablet_bootstrap.cc:654] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.253870 17333 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.254132 17333 ts_tablet_manager.cc:1398] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 19:56:35.254276 17333 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.254505 17339 tablet_bootstrap.cc:654] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.255019 17165 heartbeater.cc:503] Master 127.16.155.62:45939 was elected leader, sending a full tablet report...
I20240501 19:56:35.255213 17333 tablet_bootstrap.cc:654] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.255544 17339 tablet_bootstrap.cc:492] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.255626 17339 ts_tablet_manager.cc:1367] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.256098 17339 raft_consensus.cc:348] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.256253 17339 raft_consensus.cc:374] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.256333 17339 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.256521 17339 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.256861 17332 tablet_bootstrap.cc:492] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.256887 17333 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.256956 17332 ts_tablet_manager.cc:1367] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:56:35.256980 17333 ts_tablet_manager.cc:1367] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:56:35.257143 17339 ts_tablet_manager.cc:1398] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.257380 17339 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.257366 17332 raft_consensus.cc:348] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.257550 17332 raft_consensus.cc:374] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.257525 17333 raft_consensus.cc:348] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.257597 17332 raft_consensus.cc:729] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.257633 17333 raft_consensus.cc:374] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.257669 17333 raft_consensus.cc:729] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.257725 17332 consensus_queue.cc:260] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.257776 17333 consensus_queue.cc:260] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.258044 17332 ts_tablet_manager.cc:1398] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.258024 17333 ts_tablet_manager.cc:1398] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.258239 17332 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.258251 17333 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.259182 17332 tablet_bootstrap.cc:654] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.259251 17333 tablet_bootstrap.cc:654] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.260200 17339 tablet_bootstrap.cc:654] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.260278 17333 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.260215 17332 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.260381 17333 ts_tablet_manager.cc:1367] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.260412 17332 ts_tablet_manager.cc:1367] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.260785 17333 raft_consensus.cc:348] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.260897 17333 raft_consensus.cc:374] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.260947 17333 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.261068 17333 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.261093 17332 raft_consensus.cc:348] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.261183 17332 raft_consensus.cc:374] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.261215 17332 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.261324 17333 ts_tablet_manager.cc:1398] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.261330 17332 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.261536 17333 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.261726 17332 ts_tablet_manager.cc:1398] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.261902 17332 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.262441 17333 tablet_bootstrap.cc:654] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.262804 17339 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.262816 17332 tablet_bootstrap.cc:654] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.262909 17339 ts_tablet_manager.cc:1367] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240501 19:56:35.263309 17339 raft_consensus.cc:348] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.263415 17339 raft_consensus.cc:374] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.263447 17339 raft_consensus.cc:729] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.263553 17339 consensus_queue.cc:260] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.263811 17339 ts_tablet_manager.cc:1398] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:56:35.263866 17332 tablet_bootstrap.cc:492] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.263927 17332 ts_tablet_manager.cc:1367] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.263974 17339 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.264297 17332 raft_consensus.cc:348] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.264394 17332 raft_consensus.cc:374] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.264423 17332 raft_consensus.cc:729] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.264535 17332 consensus_queue.cc:260] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.264772 17332 ts_tablet_manager.cc:1398] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:56:35.264837 17339 tablet_bootstrap.cc:654] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.264931 17332 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.265630 17333 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.265709 17333 ts_tablet_manager.cc:1367] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:56:35.265862 17332 tablet_bootstrap.cc:654] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.266140 17333 raft_consensus.cc:348] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.266233 17333 raft_consensus.cc:374] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.266268 17333 raft_consensus.cc:729] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.266382 17333 consensus_queue.cc:260] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.266693 17333 ts_tablet_manager.cc:1398] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.266867 17333 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.267354 17339 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.267448 17339 ts_tablet_manager.cc:1367] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 19:56:35.267762 17333 tablet_bootstrap.cc:654] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.267884 17344 raft_consensus.cc:482] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.267978 17344 raft_consensus.cc:504] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.268950 17344 leader_election.cc:288] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.268982 17333 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.269230 17333 ts_tablet_manager.cc:1367] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.267771 17339 raft_consensus.cc:348] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.269435 17339 raft_consensus.cc:374] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.269500 17339 raft_consensus.cc:729] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.269655 17339 consensus_queue.cc:260] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.269660 17333 raft_consensus.cc:348] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.269809 17333 raft_consensus.cc:374] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.269840 17333 raft_consensus.cc:729] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.269929 17339 ts_tablet_manager.cc:1398] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:56:35.269951 17333 consensus_queue.cc:260] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.270120 17339 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.270283 17333 ts_tablet_manager.cc:1398] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.270423 17333 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.270442 17332 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.270529 17332 ts_tablet_manager.cc:1367] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:56:35.270951 17332 raft_consensus.cc:348] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.271035 17333 tablet_bootstrap.cc:654] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.271211 17339 tablet_bootstrap.cc:654] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.272017 17333 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.272107 17333 ts_tablet_manager.cc:1367] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:56:35.272147 17339 tablet_bootstrap.cc:492] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.272249 17339 ts_tablet_manager.cc:1367] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:56:35.272517 17333 raft_consensus.cc:348] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.272604 17333 raft_consensus.cc:374] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.272640 17333 raft_consensus.cc:729] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.272653 17339 raft_consensus.cc:348] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.272738 17339 raft_consensus.cc:374] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.272780 17339 raft_consensus.cc:729] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.272912 17339 consensus_queue.cc:260] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.273281 17339 ts_tablet_manager.cc:1398] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.271035 17332 raft_consensus.cc:374] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.273427 17332 raft_consensus.cc:729] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.273550 17332 consensus_queue.cc:260] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.273772 17332 ts_tablet_manager.cc:1398] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:56:35.273927 17332 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.272747 17333 consensus_queue.cc:260] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.274241 17333 ts_tablet_manager.cc:1398] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:56:35.274397 17333 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: Bootstrap starting.
I20240501 19:56:35.274852 17332 tablet_bootstrap.cc:654] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.275288 17333 tablet_bootstrap.cc:654] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.273909 17339 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.275946 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.276154 17215 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.276583 17103 leader_election.cc:302] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.276648 17339 tablet_bootstrap.cc:654] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.276760 17344 raft_consensus.cc:2781] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.276810 17344 raft_consensus.cc:482] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.276847 17344 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.277895 17344 raft_consensus.cc:504] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.278213 17344 leader_election.cc:288] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.278354 17337 raft_consensus.cc:482] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.278451 17337 raft_consensus.cc:504] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.278736 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.278832 17215 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.278909 17337 leader_election.cc:288] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.279448 17332 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.279534 17332 ts_tablet_manager.cc:1367] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:56:35.279840 17333 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: No bootstrap required, opened a new log
I20240501 19:56:35.279906 17333 ts_tablet_manager.cc:1367] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:56:35.279947 17332 raft_consensus.cc:348] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.280051 17332 raft_consensus.cc:374] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.280081 17332 raft_consensus.cc:729] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.280179 17290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.280313 17290 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.280366 17215 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.280319 17333 raft_consensus.cc:348] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.280449 17333 raft_consensus.cc:374] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.280472 17333 raft_consensus.cc:729] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.280547 17333 consensus_queue.cc:260] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.280557 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.280649 17289 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.280655 17103 leader_election.cc:302] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.280771 17333 ts_tablet_manager.cc:1398] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.280818 17344 raft_consensus.cc:2781] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.280887 17344 raft_consensus.cc:686] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.281003 17344 consensus_queue.cc:237] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:35.281514 17289 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.280195 17332 consensus_queue.cc:260] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.282487 17332 ts_tablet_manager.cc:1398] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:56:35.282658 17332 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: Bootstrap starting.
I20240501 19:56:35.283623 17332 tablet_bootstrap.cc:654] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.284204 17033 catalog_manager.cc:5484] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 1 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.284854 17332 tablet_bootstrap.cc:492] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: No bootstrap required, opened a new log
I20240501 19:56:35.284936 17332 ts_tablet_manager.cc:1367] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:56:35.285363 17332 raft_consensus.cc:348] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.285485 17332 raft_consensus.cc:374] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.285526 17332 raft_consensus.cc:729] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.285610 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.285637 17332 consensus_queue.cc:260] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.285707 17289 raft_consensus.cc:2454] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 0.
I20240501 19:56:35.285871 17332 ts_tablet_manager.cc:1398] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.286382 17178 leader_election.cc:302] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.286543 17339 tablet_bootstrap.cc:492] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.286608 17337 raft_consensus.cc:2781] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.286630 17339 ts_tablet_manager.cc:1367] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20240501 19:56:35.286664 17337 raft_consensus.cc:482] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.286702 17337 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.287043 17339 raft_consensus.cc:348] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.287146 17339 raft_consensus.cc:374] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.287178 17339 raft_consensus.cc:729] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.287284 17339 consensus_queue.cc:260] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.287550 17339 ts_tablet_manager.cc:1398] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.287721 17339 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.287555 17337 raft_consensus.cc:504] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.288103 17337 leader_election.cc:288] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.288396 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.288506 17289 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.288661 17339 tablet_bootstrap.cc:654] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.289376 17289 raft_consensus.cc:2454] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 1.
I20240501 19:56:35.289535 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.289736 17339 tablet_bootstrap.cc:492] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.289819 17339 ts_tablet_manager.cc:1367] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:56:35.289955 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.290254 17339 raft_consensus.cc:348] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.290366 17339 raft_consensus.cc:374] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20240501 19:56:35.290408 17179 leader_election.cc:341] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099): Illegal state: must be running to vote when last-logged opid is not known
W20240501 19:56:35.290624 17179 leader_election.cc:341] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:56:35.290750 17178 leader_election.cc:302] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:35.290905 17337 raft_consensus.cc:2781] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.290411 17339 raft_consensus.cc:729] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.291046 17339 consensus_queue.cc:260] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.291093 17337 raft_consensus.cc:686] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:35.291234 17337 consensus_queue.cc:237] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.291286 17339 ts_tablet_manager.cc:1398] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.291901 17339 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.292995 17032 catalog_manager.cc:5484] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.293211 17339 tablet_bootstrap.cc:654] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.294225 17339 tablet_bootstrap.cc:492] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.294308 17339 ts_tablet_manager.cc:1367] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:56:35.294723 17339 raft_consensus.cc:348] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.294828 17339 raft_consensus.cc:374] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.294870 17339 raft_consensus.cc:729] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.295010 17339 consensus_queue.cc:260] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.295291 17339 ts_tablet_manager.cc:1398] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:56:35.295466 17339 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Bootstrap starting.
I20240501 19:56:35.296310 17339 tablet_bootstrap.cc:654] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Neither blocks nor log segments found. Creating new log.
I20240501 19:56:35.297297 17339 tablet_bootstrap.cc:492] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: No bootstrap required, opened a new log
I20240501 19:56:35.297375 17339 ts_tablet_manager.cc:1367] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:56:35.297721 17339 raft_consensus.cc:348] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.297801 17339 raft_consensus.cc:374] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:56:35.297835 17339 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Initialized, Role: FOLLOWER
I20240501 19:56:35.297973 17339 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.298259 17339 ts_tablet_manager.cc:1398] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:56:35.326198 17336 raft_consensus.cc:482] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.326344 17336 raft_consensus.cc:504] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.326881 17336 leader_election.cc:288] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.330417 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.330590 17215 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.330680 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.330818 17137 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.330876 17255 leader_election.cc:302] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.331101 17336 raft_consensus.cc:2781] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.331157 17336 raft_consensus.cc:482] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.331184 17336 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.331982 17336 raft_consensus.cc:504] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.332320 17336 leader_election.cc:288] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.332588 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.332595 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.332685 17215 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.332722 17137 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.333408 17215 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.333503 17137 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.333720 17255 leader_election.cc:302] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.333889 17336 raft_consensus.cc:2781] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.334090 17336 raft_consensus.cc:686] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.334235 17336 consensus_queue.cc:237] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.335755 17034 catalog_manager.cc:5484] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.337559 17359 raft_consensus.cc:482] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.337644 17359 raft_consensus.cc:504] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.337975 17359 leader_election.cc:288] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.338238 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.338316 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.338346 17289 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.338438 17215 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.338636 17101 leader_election.cc:302] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.338793 17359 raft_consensus.cc:2781] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.338856 17359 raft_consensus.cc:482] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.338894 17359 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.339592 17359 raft_consensus.cc:504] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.339851 17359 leader_election.cc:288] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.340112 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.340150 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.340206 17215 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.340245 17289 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.340885 17289 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.340883 17215 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.341152 17101 leader_election.cc:302] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.341317 17359 raft_consensus.cc:2781] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.341398 17359 raft_consensus.cc:686] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.341580 17359 consensus_queue.cc:237] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.342994 17034 catalog_manager.cc:5484] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 1 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
W20240501 19:56:35.365020 17166 tablet.cc:2369] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 19:56:35.413655 17336 raft_consensus.cc:482] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.413805 17336 raft_consensus.cc:504] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.414206 17336 leader_election.cc:288] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.414556 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.414602 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.414672 17137 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.414757 17215 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.414958 17254 leader_election.cc:302] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.415143 17336 raft_consensus.cc:2781] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.415208 17336 raft_consensus.cc:482] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.415249 17336 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.416082 17336 raft_consensus.cc:504] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.416368 17336 leader_election.cc:288] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.416642 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.416642 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.416777 17215 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.416792 17137 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.417691 17137 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.417691 17215 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.417995 17255 leader_election.cc:302] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.418186 17336 raft_consensus.cc:2781] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.418280 17336 raft_consensus.cc:686] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.418439 17336 consensus_queue.cc:237] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.419905 17034 catalog_manager.cc:5484] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.453205 17359 raft_consensus.cc:482] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.453332 17359 raft_consensus.cc:504] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.453732 17359 leader_election.cc:288] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.454083 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.454083 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.454314 17289 raft_consensus.cc:2379] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in current term 1: Already voted for candidate 5d0b2e0b71014866b9e5bf08523219c1 in this term.
I20240501 19:56:35.454658 17101 leader_election.cc:302] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:35.454833 17359 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.455662 17359 raft_consensus.cc:2726] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:56:35.462543 17337 raft_consensus.cc:482] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.462639 17337 raft_consensus.cc:504] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.463058 17337 leader_election.cc:288] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.463423 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.463407 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.463577 17289 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 0.
I20240501 19:56:35.463590 17137 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 0.
I20240501 19:56:35.463843 17178 leader_election.cc:302] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.463989 17337 raft_consensus.cc:2781] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.464047 17337 raft_consensus.cc:482] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.464097 17337 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.464823 17337 raft_consensus.cc:504] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.465101 17337 leader_election.cc:288] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.465363 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.465374 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.465461 17137 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.465507 17289 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.466145 17289 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 1.
I20240501 19:56:35.466205 17137 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 1.
I20240501 19:56:35.466377 17178 leader_election.cc:302] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.466567 17337 raft_consensus.cc:2781] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.466657 17337 raft_consensus.cc:686] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:35.466815 17337 consensus_queue.cc:237] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.468318 17034 catalog_manager.cc:5484] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.504175 17336 raft_consensus.cc:482] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.504351 17336 raft_consensus.cc:504] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.504788 17336 leader_election.cc:288] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.505100 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.505110 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.505263 17137 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.505273 17215 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.505550 17254 leader_election.cc:302] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.505726 17336 raft_consensus.cc:2781] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.505779 17336 raft_consensus.cc:482] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.505805 17336 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.506572 17336 raft_consensus.cc:504] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.506886 17336 leader_election.cc:288] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.507158 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.507187 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.507249 17137 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.507267 17215 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.507917 17137 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.507941 17215 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.508172 17254 leader_election.cc:302] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.508337 17336 raft_consensus.cc:2781] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.508419 17336 raft_consensus.cc:686] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.508574 17336 consensus_queue.cc:237] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.510404 17034 catalog_manager.cc:5484] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.529554 17359 raft_consensus.cc:482] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.529693 17359 raft_consensus.cc:504] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.530086 17359 leader_election.cc:288] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.530479 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158" is_pre_election: true
I20240501 19:56:35.530479 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.530678 17215 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.530678 17289 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 0.
I20240501 19:56:35.530982 17103 leader_election.cc:302] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.531227 17359 raft_consensus.cc:2781] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.531301 17359 raft_consensus.cc:482] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.531340 17359 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.532110 17359 raft_consensus.cc:504] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.532397 17359 leader_election.cc:288] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.532693 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.532712 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.532790 17215 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.532819 17289 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.533560 17289 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.533569 17215 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 1.
I20240501 19:56:35.533824 17101 leader_election.cc:302] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.533982 17359 raft_consensus.cc:2781] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.534085 17359 raft_consensus.cc:686] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.534237 17359 consensus_queue.cc:237] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.535702 17034 catalog_manager.cc:5484] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 1 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.549641 17336 raft_consensus.cc:482] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:56:35.549777 17336 raft_consensus.cc:504] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.550240 17336 leader_election.cc:288] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.550709 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1" is_pre_election: true
I20240501 19:56:35.550709 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" is_pre_election: true
I20240501 19:56:35.550922 17215 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.550922 17137 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 0.
I20240501 19:56:35.551270 17255 leader_election.cc:302] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.551578 17336 raft_consensus.cc:2781] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:56:35.551635 17336 raft_consensus.cc:482] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:56:35.551684 17336 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.552469 17336 raft_consensus.cc:504] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.552763 17336 leader_election.cc:288] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.553124 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.553124 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.553265 17137 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.553265 17215 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:56:35.554180 17137 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.554180 17215 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 1.
I20240501 19:56:35.554543 17255 leader_election.cc:302] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.554786 17336 raft_consensus.cc:2781] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:56:35.554895 17336 raft_consensus.cc:686] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.555064 17336 consensus_queue.cc:237] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.556612 17034 catalog_manager.cc:5484] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.584542 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3186f38031e64525935a712c11e5af86"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:35.584705 17289 raft_consensus.cc:595] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Received request to transfer leadership to TS 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:35.586378 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:35.586485 17289 raft_consensus.cc:595] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Received request to transfer leadership to TS 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:35.590448 17137 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:51810
I20240501 19:56:35.590561 17137 raft_consensus.cc:595] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:35.591816 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:35.591907 17289 raft_consensus.cc:595] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:35.593972 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:35.594062 17289 raft_consensus.cc:595] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:35.598131 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:32844
I20240501 19:56:35.598232 17215 raft_consensus.cc:595] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Received request to transfer leadership to TS 03a2099a78634ff88c9829d363aa9158
I20240501 19:56:35.700749 17337 consensus_queue.cc:1035] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.702932 17367 raft_consensus.cc:979] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:35.703069 17337 raft_consensus.cc:1067] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Signalling peer 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:35.703579 17290 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:38786
I20240501 19:56:35.703773 17290 raft_consensus.cc:482] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:35.703845 17290 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.704715 17382 consensus_queue.cc:1035] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.704924 17290 raft_consensus.cc:504] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.705293 17290 leader_election.cc:288] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:35.705629 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.705766 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8925b1dbbc7482dafe3b15b898de0f1" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.705862 17215 raft_consensus.cc:3032] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:35.705906 17215 raft_consensus.cc:729] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:35.706063 17215 consensus_queue.cc:260] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.706213 17215 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.707150 17215 raft_consensus.cc:2454] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 2.
I20240501 19:56:35.707370 17255 leader_election.cc:302] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:35.707525 17336 raft_consensus.cc:2781] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:35.707623 17336 raft_consensus.cc:686] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.707774 17336 consensus_queue.cc:237] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.708950 17034 catalog_manager.cc:5484] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 1 to 2, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 2 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:35.816865 17359 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.819875 17344 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.846609 17336 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.848548 17344 consensus_queue.cc:1035] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.849648 17336 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.851552 17344 consensus_queue.cc:1035] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.853003 17336 raft_consensus.cc:979] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:35.853083 17336 raft_consensus.cc:1067] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Signalling peer 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:35.853582 17137 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3186f38031e64525935a712c11e5af86"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:51802
I20240501 19:56:35.853695 17137 raft_consensus.cc:482] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:35.853763 17137 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.854548 17344 raft_consensus.cc:979] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:35.854637 17344 raft_consensus.cc:1067] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:35.854606 17137 raft_consensus.cc:504] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.854995 17137 leader_election.cc:288] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 2 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.855381 17290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.855432 17214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.855482 17290 raft_consensus.cc:3032] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:35.855502 17214 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.855525 17290 raft_consensus.cc:729] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.855649 17290 consensus_queue.cc:260] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.855793 17290 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.855944 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32820
I20240501 19:56:35.856050 17215 raft_consensus.cc:482] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:35.856096 17215 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.856549 17290 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 2.
I20240501 19:56:35.856771 17215 raft_consensus.cc:504] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.856813 17101 leader_election.cc:302] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:35.856549 17214 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 2.
I20240501 19:56:35.856999 17393 raft_consensus.cc:2781] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:35.857091 17393 raft_consensus.cc:686] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.857331 17215 leader_election.cc:288] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.857266 17393 consensus_queue.cc:237] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.857605 17290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.857707 17290 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.858418 17290 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:35.858646 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41693109e88f4c3994097c9faa52c5cb" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.858721 17178 leader_election.cc:302] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.858758 17137 raft_consensus.cc:3032] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:35.858711 17032 catalog_manager.cc:5484] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 1 to 2, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 2 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.858881 17137 raft_consensus.cc:729] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.858927 17382 raft_consensus.cc:2781] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:35.858996 17382 raft_consensus.cc:686] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:35.859012 17137 consensus_queue.cc:260] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.859151 17137 raft_consensus.cc:3037] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.859113 17382 consensus_queue.cc:237] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.859938 17137 raft_consensus.cc:2454] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:35.860530 17034 catalog_manager.cc:5484] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 1 to 2, leader changed from 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.864840 17372 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.866482 17390 raft_consensus.cc:979] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:35.866609 17336 raft_consensus.cc:1067] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:35.867024 17214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32836
I20240501 19:56:35.867158 17214 raft_consensus.cc:482] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:35.867214 17214 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.867866 17336 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.868171 17214 raft_consensus.cc:504] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.868501 17214 leader_election.cc:288] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.868741 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:35.869120 17290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.869233 17290 raft_consensus.cc:3032] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:35.869283 17290 raft_consensus.cc:729] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.869421 17290 consensus_queue.cc:260] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.869699 17290 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.870625 17290 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:35.870877 17178 leader_election.cc:302] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:35.871040 17337 raft_consensus.cc:2781] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:35.871152 17337 raft_consensus.cc:686] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:35.871281 17337 consensus_queue.cc:237] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.872462 17032 catalog_manager.cc:5484] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 1 to 2, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:35.904471 17336 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.907369 17336 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.909162 17336 raft_consensus.cc:979] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:35.909261 17336 raft_consensus.cc:1067] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Signalling peer 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:35.909540 17337 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.909617 17138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:51802
I20240501 19:56:35.909703 17138 raft_consensus.cc:482] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:35.909750 17138 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.910710 17138 raft_consensus.cc:504] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.911262 17214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:35.911371 17214 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.911293 17290 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:35.911813 17290 raft_consensus.cc:3032] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:35.911859 17290 raft_consensus.cc:729] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:35.911971 17290 consensus_queue.cc:260] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.912125 17290 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:35.912230 17401 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:35.912312 17214 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 2.
I20240501 19:56:35.912541 17103 leader_election.cc:302] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:35.912716 17393 raft_consensus.cc:2781] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:35.912798 17393 raft_consensus.cc:686] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:35.912917 17393 consensus_queue.cc:237] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:35.913039 17290 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 2.
I20240501 19:56:35.913923 17138 leader_election.cc:288] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 2 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:35.915763 17034 catalog_manager.cc:5484] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 1 to 2, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 2 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:36.029147 17336 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:36.029996 17344 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:36.032711 17336 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:36.032985 17359 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:56:36.036119 17372 raft_consensus.cc:979] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:36.036206 17372 raft_consensus.cc:1067] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:36.036556 17214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32836
I20240501 19:56:36.036635 17214 raft_consensus.cc:482] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:36.036671 17214 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:36.037490 17214 raft_consensus.cc:504] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:36.037796 17214 leader_election.cc:288] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:36.038070 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:36.038192 17138 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:36.038070 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:36.038296 17289 raft_consensus.cc:3032] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:36.038340 17289 raft_consensus.cc:729] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:36.038458 17289 consensus_queue.cc:260] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:36.038601 17289 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:36.038869 17138 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:36.039129 17179 leader_election.cc:302] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:36.039283 17401 raft_consensus.cc:2781] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:36.039340 17289 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:36.039398 17401 raft_consensus.cc:686] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:36.039558 17401 consensus_queue.cc:237] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:36.040710 17034 catalog_manager.cc:5484] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 1 to 2, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:36.222524 17214 raft_consensus.cc:1261] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.223202 17336 consensus_queue.cc:1035] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.226028 17138 raft_consensus.cc:3037] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:36.227247 17138 raft_consensus.cc:1261] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.227667 17390 consensus_queue.cc:1035] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.260286 17289 raft_consensus.cc:1261] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.260761 17393 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.263550 17214 raft_consensus.cc:1261] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.263883 17359 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.277791 17289 raft_consensus.cc:1261] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.278185 17401 consensus_queue.cc:1035] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.280151 17138 raft_consensus.cc:1261] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.280550 17401 consensus_queue.cc:1035] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.321897 17289 raft_consensus.cc:1261] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.322379 17359 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.324764 17215 raft_consensus.cc:1261] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.325103 17344 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.417557 17138 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:36.418540 17138 raft_consensus.cc:1261] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.418937 17337 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.421442 17289 raft_consensus.cc:1261] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.421835 17337 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.439270 17138 raft_consensus.cc:1261] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.439677 17337 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:36.442128 17289 raft_consensus.cc:1261] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:36.442514 17337 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:38.605806 17004 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240501 19:56:38.606050 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:38.610893 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:38.611035 17215 raft_consensus.cc:595] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Received request to transfer leadership to TS 03a2099a78634ff88c9829d363aa9158
I20240501 19:56:38.614662 17138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
mode: GRACEFUL
new_leader_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:51820
I20240501 19:56:38.614782 17138 raft_consensus.cc:595] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Received request to transfer leadership to TS 03a2099a78634ff88c9829d363aa9158
I20240501 19:56:38.615166 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 19:56:38.615357 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:38.619180 17359 raft_consensus.cc:979] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: : Instructing follower 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:38.619279 17359 raft_consensus.cc:1067] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Signalling peer 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:38.619654 17289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:38782
I20240501 19:56:38.619751 17289 raft_consensus.cc:482] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:38.619793 17289 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:38.620579 17289 raft_consensus.cc:504] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:38.620884 17289 leader_election.cc:288] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:38.621192 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:38.621259 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:38.621313 17215 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:38.621351 17138 raft_consensus.cc:3032] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:38.621388 17138 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:38.621567 17138 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:38.621735 17138 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:38.622217 17215 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 2.
I20240501 19:56:38.622507 17138 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 2.
I20240501 19:56:38.622524 17255 leader_election.cc:302] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:38.622694 17336 raft_consensus.cc:2781] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:38.622912 17336 raft_consensus.cc:686] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:38.623078 17336 consensus_queue.cc:237] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:38.624568 17032 catalog_manager.cc:5484] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 1 to 2, leader changed from 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1) to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 2 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:39.059859 17215 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:39.060353 17336 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:39.063055 17138 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:39.063812 17336 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:39.118455 17337 raft_consensus.cc:979] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:39.118566 17337 raft_consensus.cc:1067] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Signalling peer 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:39.118980 17289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:38786
I20240501 19:56:39.119122 17289 raft_consensus.cc:482] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:39.119191 17289 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:39.120093 17289 raft_consensus.cc:504] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:39.120456 17289 leader_election.cc:288] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:39.120726 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:39.120747 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:39.120872 17215 raft_consensus.cc:3032] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:39.120872 17138 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:39.120954 17215 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:39.121111 17215 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:39.121299 17215 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:39.121949 17138 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 2.
I20240501 19:56:39.122220 17254 leader_election.cc:302] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:39.122273 17215 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 2.
I20240501 19:56:39.122416 17336 raft_consensus.cc:2781] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:39.122534 17336 raft_consensus.cc:686] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:39.122656 17336 consensus_queue.cc:237] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:39.124145 17034 catalog_manager.cc:5484] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 1 to 2, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 2 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:39.518716 17215 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:39.519174 17412 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:39.521508 17138 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:39.521894 17412 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:39.615664 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:39.616827 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:39.616923 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:40.617234 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:40.618317 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:40.618396 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:41.618665 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:41.619541 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:41.619617 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:42.619911 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:42.620872 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:42.620944 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:43.621256 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:43.622206 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:43.622282 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:44.622572 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:44.623489 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:44.623569 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:45.623893 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:45.624766 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:45.624838 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:46.625169 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:46.626178 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:46.626262 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:47.635028 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:47.635908 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:47.635985 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:48.642731 17004 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240501 19:56:48.643889 17138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:51810
I20240501 19:56:48.644027 17138 raft_consensus.cc:595] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:48.645310 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:48.645401 17289 raft_consensus.cc:595] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:48.646653 17138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3186f38031e64525935a712c11e5af86"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:51810
I20240501 19:56:48.646744 17138 raft_consensus.cc:595] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:48.648022 17138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:51810
I20240501 19:56:48.648108 17138 raft_consensus.cc:595] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:48.650681 17289 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
mode: GRACEFUL
new_leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:38802
I20240501 19:56:48.650786 17289 raft_consensus.cc:595] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Received request to transfer leadership to TS 5d0b2e0b71014866b9e5bf08523219c1
I20240501 19:56:48.693518 17428 raft_consensus.cc:979] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.693637 17428 raft_consensus.cc:1067] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.694075 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32820
I20240501 19:56:48.694202 17215 raft_consensus.cc:482] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:48.694270 17215 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:48.695124 17215 raft_consensus.cc:504] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:48.695541 17215 leader_election.cc:288] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Requested vote from peers 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167), 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099)
I20240501 19:56:48.695802 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:48.695820 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:48.695950 17289 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:48.695973 17138 raft_consensus.cc:3032] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:56:48.696012 17138 raft_consensus.cc:729] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:48.696149 17138 consensus_queue.cc:260] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:48.696317 17138 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:56:48.696799 17289 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:48.697072 17178 leader_election.cc:302] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:48.697216 17138 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 2.
I20240501 19:56:48.697260 17337 raft_consensus.cc:2781] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:56:48.697506 17337 raft_consensus.cc:686] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:48.697669 17337 consensus_queue.cc:237] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:48.699256 17032 catalog_manager.cc:5484] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 1 to 2, leader changed from 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:48.784718 17434 raft_consensus.cc:979] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.784847 17434 raft_consensus.cc:1067] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.785346 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3186f38031e64525935a712c11e5af86"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32820
I20240501 19:56:48.785503 17215 raft_consensus.cc:482] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:48.785574 17215 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.786433 17215 raft_consensus.cc:504] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.786806 17215 leader_election.cc:288] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:48.787134 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:48.787117 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3186f38031e64525935a712c11e5af86" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:48.787263 17289 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.787290 17138 raft_consensus.cc:3032] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:48.787333 17138 raft_consensus.cc:729] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:48.787480 17138 consensus_queue.cc:260] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.787653 17138 raft_consensus.cc:3037] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.788254 17289 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.788566 17138 raft_consensus.cc:2454] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.788583 17178 leader_election.cc:302] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:48.788771 17337 raft_consensus.cc:2781] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:48.788898 17337 raft_consensus.cc:686] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:48.789070 17337 consensus_queue.cc:237] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.790607 17032 catalog_manager.cc:5484] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 2 to 3, leader changed from 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:48.900529 17428 raft_consensus.cc:979] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.900638 17428 raft_consensus.cc:1067] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.901021 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32820
I20240501 19:56:48.901146 17215 raft_consensus.cc:482] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:48.901216 17215 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.902117 17215 raft_consensus.cc:504] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.902480 17215 leader_election.cc:288] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:48.902726 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:48.902797 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a9bdc91aebe4a13acc89ce072c8cd9e" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:48.902845 17138 raft_consensus.cc:3032] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:48.902868 17289 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.902894 17138 raft_consensus.cc:729] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:48.903028 17138 consensus_queue.cc:260] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.903182 17138 raft_consensus.cc:3037] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.903777 17289 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.904011 17138 raft_consensus.cc:2454] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.904018 17178 leader_election.cc:302] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:48.904249 17337 raft_consensus.cc:2781] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:48.904352 17337 raft_consensus.cc:686] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:48.904516 17337 consensus_queue.cc:237] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.905997 17032 catalog_manager.cc:5484] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 2 to 3, leader changed from 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:48.913789 17427 raft_consensus.cc:979] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.913870 17427 raft_consensus.cc:1067] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:48.914255 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32836
I20240501 19:56:48.914357 17215 raft_consensus.cc:482] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:48.914422 17215 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.915163 17215 raft_consensus.cc:504] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.915498 17215 leader_election.cc:288] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:48.915789 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:48.915812 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:48.915882 17138 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.915907 17289 raft_consensus.cc:3032] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:48.915962 17289 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:48.916110 17289 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.916262 17289 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:48.916690 17138 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.916937 17179 leader_election.cc:302] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:48.917085 17337 raft_consensus.cc:2781] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:48.917142 17289 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:48.917166 17337 raft_consensus.cc:686] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:48.917364 17337 consensus_queue.cc:237] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:48.918974 17032 catalog_manager.cc:5484] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 2 to 3, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:49.064383 17443 raft_consensus.cc:979] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: : Instructing follower 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:49.064550 17443 raft_consensus.cc:1067] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Signalling peer 5d0b2e0b71014866b9e5bf08523219c1 to start an election
I20240501 19:56:49.064963 17215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
from {username='slave'} at 127.0.0.1:32836
I20240501 19:56:49.065091 17215 raft_consensus.cc:482] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:49.065155 17215 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:49.067116 17215 raft_consensus.cc:504] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:49.067514 17215 leader_election.cc:288] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:49.067782 17138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:49.067845 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "5d0b2e0b71014866b9e5bf08523219c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:49.067900 17138 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:49.067961 17289 raft_consensus.cc:3032] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:49.068018 17289 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:49.068136 17289 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:49.068281 17289 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:49.068722 17138 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:49.068976 17179 leader_election.cc:302] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28fe50ad6c9b43cf958e8aa3d10b3b6b, 5d0b2e0b71014866b9e5bf08523219c1; no voters:
I20240501 19:56:49.069110 17289 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0b2e0b71014866b9e5bf08523219c1 in term 3.
I20240501 19:56:49.069152 17337 raft_consensus.cc:2781] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:49.069226 17337 raft_consensus.cc:686] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Leader. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:49.069362 17337 consensus_queue.cc:237] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:49.070873 17032 catalog_manager.cc:5484] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 reported cstate change: term changed from 2 to 3, leader changed from 03a2099a78634ff88c9829d363aa9158 (127.16.155.3) to 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "5d0b2e0b71014866b9e5bf08523219c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:49.114974 17289 raft_consensus.cc:1261] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:49.115399 17337 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:49.118176 17138 raft_consensus.cc:1261] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:56:49.118656 17337 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:56:49.244721 17289 raft_consensus.cc:1261] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.245117 17337 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.247489 17138 raft_consensus.cc:1261] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.247913 17452 consensus_queue.cc:1035] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.343333 17289 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.343848 17452 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.346580 17138 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.346933 17456 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.347210 17138 raft_consensus.cc:1261] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.348193 17452 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.350122 17289 raft_consensus.cc:1261] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.350435 17337 consensus_queue.cc:1035] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.461367 17138 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.461858 17337 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:49.464165 17289 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Refusing update from remote peer 5d0b2e0b71014866b9e5bf08523219c1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:49.464579 17452 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:51.659253 17004 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240501 19:56:51.659409 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:51.660598 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:51.660743 17215 raft_consensus.cc:595] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Received request to transfer leadership to TS 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:51.661439 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:51.661572 17215 raft_consensus.cc:595] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Received request to transfer leadership to TS 03a2099a78634ff88c9829d363aa9158
I20240501 19:56:51.662189 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:51.662282 17215 raft_consensus.cc:595] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Received request to transfer leadership to TS 03a2099a78634ff88c9829d363aa9158
I20240501 19:56:51.662870 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:51.662963 17215 raft_consensus.cc:595] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Received request to transfer leadership to TS 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:51.663547 17215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
mode: GRACEFUL
new_leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:32846
I20240501 19:56:51.663640 17215 raft_consensus.cc:595] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Received request to transfer leadership to TS 28fe50ad6c9b43cf958e8aa3d10b3b6b
I20240501 19:56:51.663911 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240501 19:56:51.664012 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:51.682209 17452 raft_consensus.cc:979] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:51.682292 17452 raft_consensus.cc:1067] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Signalling peer 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:51.682667 17137 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:51792
I20240501 19:56:51.682767 17137 raft_consensus.cc:482] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:51.682835 17137 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.683815 17137 raft_consensus.cc:504] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.684244 17137 leader_election.cc:288] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 3 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:51.684528 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:51.684579 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c99ec29b6144dc1a569a929d5d20f9e" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:51.684651 17289 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.684651 17215 raft_consensus.cc:3032] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:51.684718 17215 raft_consensus.cc:729] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:51.684859 17215 consensus_queue.cc:260] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.685037 17215 raft_consensus.cc:3037] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.685639 17289 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 3.
I20240501 19:56:51.685935 17101 leader_election.cc:302] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:51.685981 17215 raft_consensus.cc:2454] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 3.
I20240501 19:56:51.686204 17463 raft_consensus.cc:2781] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:51.686342 17463 raft_consensus.cc:686] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:51.686479 17463 consensus_queue.cc:237] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.687812 17032 catalog_manager.cc:5484] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 2 to 3, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 3 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:51.782389 17462 raft_consensus.cc:979] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:51.782512 17462 raft_consensus.cc:1067] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Signalling peer 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:51.782979 17289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:38786
I20240501 19:56:51.783133 17289 raft_consensus.cc:482] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:51.783213 17289 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.784044 17289 raft_consensus.cc:504] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.784493 17289 leader_election.cc:288] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 3 election: Requested vote from peers 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099), 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409)
I20240501 19:56:51.784828 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:51.784828 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7315b8c7084c4619b2c1cbe95f16df12" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:51.784984 17215 raft_consensus.cc:3032] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:51.784984 17137 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.785050 17215 raft_consensus.cc:729] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:51.785199 17215 consensus_queue.cc:260] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.785369 17215 raft_consensus.cc:3037] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:51.786042 17137 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 3.
I20240501 19:56:51.786306 17215 raft_consensus.cc:2454] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 3.
I20240501 19:56:51.786382 17254 leader_election.cc:302] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:51.786556 17443 raft_consensus.cc:2781] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:51.786774 17443 raft_consensus.cc:686] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 3 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:51.786911 17443 consensus_queue.cc:237] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.788349 17032 catalog_manager.cc:5484] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 2 to 3, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 3 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } }
I20240501 19:56:51.960189 17452 raft_consensus.cc:979] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:51.960316 17452 raft_consensus.cc:1067] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Signalling peer 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:51.960882 17137 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:51792
I20240501 19:56:51.961053 17137 raft_consensus.cc:482] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:51.961143 17137 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:51.962021 17137 raft_consensus.cc:504] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.962370 17137 leader_election.cc:288] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 4 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:51.962714 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:51.962730 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b218472eb1424166a3b325d962cb28e1" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:51.962839 17289 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:51.962855 17215 raft_consensus.cc:3032] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 19:56:51.962900 17215 raft_consensus.cc:729] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:51.963064 17215 consensus_queue.cc:260] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.963217 17215 raft_consensus.cc:3037] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:51.963691 17289 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 4.
I20240501 19:56:51.963914 17215 raft_consensus.cc:2454] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 4.
I20240501 19:56:51.963997 17101 leader_election.cc:302] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:51.964154 17463 raft_consensus.cc:2781] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Leader election won for term 4
I20240501 19:56:51.964242 17463 raft_consensus.cc:686] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:51.964375 17463 consensus_queue.cc:237] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:51.966030 17032 catalog_manager.cc:5484] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 3 to 4, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 4 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:52.079576 17462 raft_consensus.cc:979] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:52.079695 17462 raft_consensus.cc:1067] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Signalling peer 28fe50ad6c9b43cf958e8aa3d10b3b6b to start an election
I20240501 19:56:52.080165 17137 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6"
dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
from {username='slave'} at 127.0.0.1:51792
I20240501 19:56:52.080322 17137 raft_consensus.cc:482] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:52.080401 17137 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:52.081228 17137 raft_consensus.cc:504] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:52.081614 17137 leader_election.cc:288] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 4 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 03a2099a78634ff88c9829d363aa9158 (127.16.155.3:33167)
I20240501 19:56:52.081941 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:52.081941 17289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3e1da6711d4444082c8fab1f9a935a6" candidate_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "03a2099a78634ff88c9829d363aa9158"
I20240501 19:56:52.082096 17215 raft_consensus.cc:3032] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 19:56:52.082103 17289 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:52.082166 17215 raft_consensus.cc:729] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:52.082324 17215 consensus_queue.cc:260] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:52.082511 17215 raft_consensus.cc:3037] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:56:52.083145 17289 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 4.
I20240501 19:56:52.083410 17215 raft_consensus.cc:2454] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28fe50ad6c9b43cf958e8aa3d10b3b6b in term 4.
I20240501 19:56:52.083451 17101 leader_election.cc:302] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:52.083700 17463 raft_consensus.cc:2781] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Leader election won for term 4
I20240501 19:56:52.083791 17463 raft_consensus.cc:686] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 LEADER]: Becoming Leader. State: Replica: 28fe50ad6c9b43cf958e8aa3d10b3b6b, State: Running, Role: LEADER
I20240501 19:56:52.083949 17463 consensus_queue.cc:237] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } }
I20240501 19:56:52.085753 17032 catalog_manager.cc:5484] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b reported cstate change: term changed from 3 to 4, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1). New cstate: current_term: 4 leader_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:52.136102 17215 raft_consensus.cc:1261] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.136535 17463 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:52.139031 17289 raft_consensus.cc:1261] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.139561 17464 consensus_queue.cc:1035] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:52.140827 17452 raft_consensus.cc:979] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: : Instructing follower 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:52.140938 17452 raft_consensus.cc:1067] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Signalling peer 03a2099a78634ff88c9829d363aa9158 to start an election
I20240501 19:56:52.141291 17289 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8"
dest_uuid: "03a2099a78634ff88c9829d363aa9158"
from {username='slave'} at 127.0.0.1:38786
I20240501 19:56:52.141393 17289 raft_consensus.cc:482] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:56:52.141461 17289 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:52.142529 17289 raft_consensus.cc:504] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:52.142894 17289 leader_election.cc:288] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2:35409), 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099)
I20240501 19:56:52.143116 17215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5d0b2e0b71014866b9e5bf08523219c1"
I20240501 19:56:52.143227 17215 raft_consensus.cc:3032] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:56:52.143275 17215 raft_consensus.cc:729] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0b2e0b71014866b9e5bf08523219c1, State: Running, Role: LEADER
I20240501 19:56:52.143291 17137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "823ea1290c68453a8ae22cf2bc0d59a8" candidate_uuid: "03a2099a78634ff88c9829d363aa9158" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b"
I20240501 19:56:52.143409 17137 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:52.143409 17215 consensus_queue.cc:260] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:52.143592 17215 raft_consensus.cc:3037] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:56:52.144100 17137 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 3.
I20240501 19:56:52.144381 17254 leader_election.cc:302] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03a2099a78634ff88c9829d363aa9158, 28fe50ad6c9b43cf958e8aa3d10b3b6b; no voters:
I20240501 19:56:52.144454 17215 raft_consensus.cc:2454] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03a2099a78634ff88c9829d363aa9158 in term 3.
I20240501 19:56:52.144585 17470 raft_consensus.cc:2781] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:56:52.144661 17470 raft_consensus.cc:686] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 3 LEADER]: Becoming Leader. State: Replica: 03a2099a78634ff88c9829d363aa9158, State: Running, Role: LEADER
I20240501 19:56:52.144781 17470 consensus_queue.cc:237] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } }
I20240501 19:56:52.146112 17034 catalog_manager.cc:5484] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 reported cstate change: term changed from 2 to 3, leader changed from 5d0b2e0b71014866b9e5bf08523219c1 (127.16.155.2) to 03a2099a78634ff88c9829d363aa9158 (127.16.155.3). New cstate: current_term: 3 leader_uuid: "03a2099a78634ff88c9829d363aa9158" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 } health_report { overall_health: UNKNOWN } } }
I20240501 19:56:52.254787 17215 raft_consensus.cc:1261] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.255278 17443 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:52.257966 17137 raft_consensus.cc:1261] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.258788 17443 consensus_queue.cc:1035] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:52.530426 17215 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:56:52.530897 17463 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:56:52.533890 17289 raft_consensus.cc:1261] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:56:52.534515 17464 consensus_queue.cc:1035] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:56:52.590752 17215 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:56:52.591207 17464 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:56:52.593619 17289 raft_consensus.cc:1261] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Refusing update from remote peer 28fe50ad6c9b43cf958e8aa3d10b3b6b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:56:52.594069 17485 consensus_queue.cc:1035] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "03a2099a78634ff88c9829d363aa9158" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 33167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:56:52.664288 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:52.664659 17215 raft_consensus.cc:1261] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.665117 17443 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0b2e0b71014866b9e5bf08523219c1" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 35409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:56:52.665598 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:52.665663 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:52.667603 17137 raft_consensus.cc:1261] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Refusing update from remote peer 03a2099a78634ff88c9829d363aa9158: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:56:52.668455 17488 consensus_queue.cc:1035] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [LEADER]: Connected to new peer: Peer: permanent_uuid: "28fe50ad6c9b43cf958e8aa3d10b3b6b" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20240501 19:56:53.665916 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:53.666811 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:53.666888 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:54.667187 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:54.668206 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:54.668298 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:55.668603 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:55.669900 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:55.669981 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:56.670261 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:56.671195 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:56.671294 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:57.671545 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:57.672443 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:57.672516 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:58.672780 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:58.673724 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:58.673803 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:56:59.674091 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:56:59.674947 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:56:59.675030 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:00.675305 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:00.676167 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:00.676240 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:01.682749 17004 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240501 19:57:01.682945 17004 tablet_server.cc:178] TabletServer@127.16.155.1:0 shutting down...
I20240501 19:57:01.687366 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:01.687554 17004 tablet_replica.cc:330] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.687780 17004 raft_consensus.cc:2229] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.687999 17004 raft_consensus.cc:2258] T b218472eb1424166a3b325d962cb28e1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.688899 17004 tablet_replica.cc:330] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.689018 17004 raft_consensus.cc:2229] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.689119 17004 raft_consensus.cc:2258] T a8925b1dbbc7482dafe3b15b898de0f1 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.689415 17004 tablet_replica.cc:330] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.689527 17004 raft_consensus.cc:2229] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.689677 17004 raft_consensus.cc:2258] T e3e1da6711d4444082c8fab1f9a935a6 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.689966 17004 tablet_replica.cc:330] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.690073 17004 raft_consensus.cc:2229] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.690167 17004 raft_consensus.cc:2258] T 823ea1290c68453a8ae22cf2bc0d59a8 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.690441 17004 tablet_replica.cc:330] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.690541 17004 raft_consensus.cc:2229] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.690677 17004 raft_consensus.cc:2258] T 5c99ec29b6144dc1a569a929d5d20f9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.690970 17004 tablet_replica.cc:330] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.691074 17004 raft_consensus.cc:2229] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.691162 17004 raft_consensus.cc:2258] T 3186f38031e64525935a712c11e5af86 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.691437 17004 tablet_replica.cc:330] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.691530 17004 raft_consensus.cc:2229] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.691615 17004 raft_consensus.cc:2258] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.691882 17004 tablet_replica.cc:330] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.691973 17004 raft_consensus.cc:2229] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.692067 17004 raft_consensus.cc:2258] T 41693109e88f4c3994097c9faa52c5cb P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.692339 17004 tablet_replica.cc:330] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b: stopping tablet replica
I20240501 19:57:01.692427 17004 raft_consensus.cc:2229] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.692519 17004 raft_consensus.cc:2258] T 7315b8c7084c4619b2c1cbe95f16df12 P 28fe50ad6c9b43cf958e8aa3d10b3b6b [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.707039 17004 tablet_server.cc:194] TabletServer@127.16.155.1:0 shutdown complete.
I20240501 19:57:01.711050 17004 tablet_server.cc:178] TabletServer@127.16.155.2:0 shutting down...
I20240501 19:57:01.715808 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:01.716004 17004 tablet_replica.cc:330] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.716140 17004 raft_consensus.cc:2229] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.716317 17004 raft_consensus.cc:2258] T 41693109e88f4c3994097c9faa52c5cb P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.716658 17004 tablet_replica.cc:330] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.716737 17004 raft_consensus.cc:2229] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.716881 17004 raft_consensus.cc:2258] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.717211 17004 tablet_replica.cc:330] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.717303 17004 raft_consensus.cc:2229] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.717384 17004 raft_consensus.cc:2258] T 7315b8c7084c4619b2c1cbe95f16df12 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.717680 17004 tablet_replica.cc:330] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.717753 17004 raft_consensus.cc:2229] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.717823 17004 raft_consensus.cc:2258] T 823ea1290c68453a8ae22cf2bc0d59a8 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.718106 17004 tablet_replica.cc:330] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.718199 17004 raft_consensus.cc:2229] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.718272 17004 raft_consensus.cc:2258] T 5c99ec29b6144dc1a569a929d5d20f9e P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.718516 17004 tablet_replica.cc:330] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.718585 17004 raft_consensus.cc:2229] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.718652 17004 raft_consensus.cc:2258] T a8925b1dbbc7482dafe3b15b898de0f1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.718885 17004 tablet_replica.cc:330] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.718952 17004 raft_consensus.cc:2229] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.719079 17004 raft_consensus.cc:2258] T 3186f38031e64525935a712c11e5af86 P 5d0b2e0b71014866b9e5bf08523219c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.719322 17004 tablet_replica.cc:330] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.719385 17004 raft_consensus.cc:2229] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.719450 17004 raft_consensus.cc:2258] T e3e1da6711d4444082c8fab1f9a935a6 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.719682 17004 tablet_replica.cc:330] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1: stopping tablet replica
I20240501 19:57:01.719743 17004 raft_consensus.cc:2229] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.719806 17004 raft_consensus.cc:2258] T b218472eb1424166a3b325d962cb28e1 P 5d0b2e0b71014866b9e5bf08523219c1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20240501 19:57:01.727566 17254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.155.1:38099: connect: Connection refused (error 111)
W20240501 19:57:01.728240 17254 consensus_peers.cc:485] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 -> Peer 28fe50ad6c9b43cf958e8aa3d10b3b6b (127.16.155.1:38099): Couldn't send request to peer 28fe50ad6c9b43cf958e8aa3d10b3b6b. Status: Network error: Client connection negotiation failed: client connection to 127.16.155.1:38099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:01.733765 17004 tablet_server.cc:194] TabletServer@127.16.155.2:0 shutdown complete.
I20240501 19:57:01.736001 17004 tablet_server.cc:178] TabletServer@127.16.155.3:0 shutting down...
I20240501 19:57:01.740471 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:01.740677 17004 tablet_replica.cc:330] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.740788 17004 raft_consensus.cc:2229] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.740933 17004 raft_consensus.cc:2258] T a8925b1dbbc7482dafe3b15b898de0f1 P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.741250 17004 tablet_replica.cc:330] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.741325 17004 raft_consensus.cc:2229] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.741398 17004 raft_consensus.cc:2258] T 5c99ec29b6144dc1a569a929d5d20f9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.741694 17004 tablet_replica.cc:330] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.741767 17004 raft_consensus.cc:2229] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.741835 17004 raft_consensus.cc:2258] T e3e1da6711d4444082c8fab1f9a935a6 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.742076 17004 tablet_replica.cc:330] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.742144 17004 raft_consensus.cc:2229] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.742209 17004 raft_consensus.cc:2258] T 41693109e88f4c3994097c9faa52c5cb P 03a2099a78634ff88c9829d363aa9158 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.742436 17004 tablet_replica.cc:330] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.742501 17004 raft_consensus.cc:2229] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.742574 17004 raft_consensus.cc:2258] T 4a9bdc91aebe4a13acc89ce072c8cd9e P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.742800 17004 tablet_replica.cc:330] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.742866 17004 raft_consensus.cc:2229] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.742997 17004 raft_consensus.cc:2258] T 823ea1290c68453a8ae22cf2bc0d59a8 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.743319 17004 tablet_replica.cc:330] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.743393 17004 raft_consensus.cc:2229] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.743559 17004 raft_consensus.cc:2258] T 7315b8c7084c4619b2c1cbe95f16df12 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.743841 17004 tablet_replica.cc:330] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.743919 17004 raft_consensus.cc:2229] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.744004 17004 raft_consensus.cc:2258] T 3186f38031e64525935a712c11e5af86 P 03a2099a78634ff88c9829d363aa9158 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.744280 17004 tablet_replica.cc:330] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158: stopping tablet replica
I20240501 19:57:01.744351 17004 raft_consensus.cc:2229] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:01.744444 17004 raft_consensus.cc:2258] T b218472eb1424166a3b325d962cb28e1 P 03a2099a78634ff88c9829d363aa9158 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.757580 17004 tablet_server.cc:194] TabletServer@127.16.155.3:0 shutdown complete.
I20240501 19:57:01.760064 17004 master.cc:537] Master@127.16.155.62:45939 shutting down...
I20240501 19:57:01.763983 17004 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 1 LEADER]: Raft consensus shutting down.
I20240501 19:57:01.764112 17004 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:01.764184 17004 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1d218fcb2a8546ae91d393baaec706e7: stopping tablet replica
I20240501 19:57:01.776151 17004 master.cc:552] Master@127.16.155.62:45939 shutdown complete.
03a2099a78634ff88c9829d363aa9158 1
28fe50ad6c9b43cf958e8aa3d10b3b6b 4
5d0b2e0b71014866b9e5bf08523219c1 4
03a2099a78634ff88c9829d363aa9158 3
28fe50ad6c9b43cf958e8aa3d10b3b6b 3
5d0b2e0b71014866b9e5bf08523219c1 3
03a2099a78634ff88c9829d363aa9158 1
28fe50ad6c9b43cf958e8aa3d10b3b6b 0
5d0b2e0b71014866b9e5bf08523219c1 8
03a2099a78634ff88c9829d363aa9158 3
28fe50ad6c9b43cf958e8aa3d10b3b6b 3
5d0b2e0b71014866b9e5bf08523219c1 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (26849 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240501 19:57:01.787093 17004 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.155.62:40855
I20240501 19:57:01.787374 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:01.790088 17496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.790706 17499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.791453 17004 server_base.cc:1034] running on GCE node
W20240501 19:57:01.792089 17497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.792294 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:01.792344 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:01.792367 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593421792366 us; error 0 us; skew 500 ppm
I20240501 19:57:01.798049 17004 webserver.cc:460] Webserver started at http://127.16.155.62:35343/ using document root <none> and password file <none>
I20240501 19:57:01.798211 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:01.798264 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:01.798342 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:01.798725 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/master-0-root/instance:
uuid: "758d00823581471294d60ad4a85ebfc4"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.800228 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:01.801136 17504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.801343 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.801414 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/master-0-root
uuid: "758d00823581471294d60ad4a85ebfc4"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.801496 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:01.812611 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:01.812958 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:01.816848 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.62:40855
I20240501 19:57:01.819980 17556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.62:40855 every 8 connection(s)
I20240501 19:57:01.820390 17557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.822074 17557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4: Bootstrap starting.
I20240501 19:57:01.822778 17557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.823658 17557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4: No bootstrap required, opened a new log
I20240501 19:57:01.823997 17557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER }
I20240501 19:57:01.824098 17557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:01.824134 17557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 758d00823581471294d60ad4a85ebfc4, State: Initialized, Role: FOLLOWER
I20240501 19:57:01.824260 17557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER }
I20240501 19:57:01.824327 17557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 19:57:01.824370 17557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 19:57:01.824422 17557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:01.825033 17557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER }
I20240501 19:57:01.825150 17557 leader_election.cc:302] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 758d00823581471294d60ad4a85ebfc4; no voters:
I20240501 19:57:01.825301 17557 leader_election.cc:288] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 19:57:01.825410 17560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:01.825626 17560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 1 LEADER]: Becoming Leader. State: Replica: 758d00823581471294d60ad4a85ebfc4, State: Running, Role: LEADER
I20240501 19:57:01.825716 17557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 19:57:01.825764 17560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER }
I20240501 19:57:01.826195 17561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "758d00823581471294d60ad4a85ebfc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER } }
I20240501 19:57:01.826237 17562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 758d00823581471294d60ad4a85ebfc4. Latest consensus state: current_term: 1 leader_uuid: "758d00823581471294d60ad4a85ebfc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "758d00823581471294d60ad4a85ebfc4" member_type: VOTER } }
I20240501 19:57:01.826370 17561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [sys.catalog]: This master's current role is: LEADER
I20240501 19:57:01.826383 17562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [sys.catalog]: This master's current role is: LEADER
I20240501 19:57:01.826848 17568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 19:57:01.827759 17568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 19:57:01.827963 17004 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 19:57:01.829797 17568 catalog_manager.cc:1347] Generated new cluster ID: 1da071df417b4fd5b39397d9dcc91108
I20240501 19:57:01.829859 17568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 19:57:01.844071 17568 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 19:57:01.844617 17568 catalog_manager.cc:1504] Loading token signing keys...
I20240501 19:57:01.849176 17568 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4: Generated new TSK 0
I20240501 19:57:01.849323 17568 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 19:57:01.860301 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:01.862555 17578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.863379 17581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.864079 17579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.864777 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:01.864913 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:01.864945 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:01.864960 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593421864960 us; error 0 us; skew 500 ppm
I20240501 19:57:01.865828 17004 webserver.cc:460] Webserver started at http://127.16.155.1:34787/ using document root <none> and password file <none>
I20240501 19:57:01.865955 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:01.865995 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:01.866066 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:01.866403 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-0-root/instance:
uuid: "4de0dc200c734d0189121875be08d711"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.867749 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:01.868547 17586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.868759 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.868826 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
uuid: "4de0dc200c734d0189121875be08d711"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.868894 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:01.877416 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:01.877739 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:01.878000 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:01.878424 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:01.878461 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.878515 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:01.878547 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.882220 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.1:37353
I20240501 19:57:01.882241 17649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.1:37353 every 8 connection(s)
I20240501 19:57:01.883016 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:01.885396 17654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.886181 17655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.886849 17657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.887207 17650 heartbeater.cc:347] Connected to a master server at 127.16.155.62:40855
I20240501 19:57:01.887295 17650 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:01.887491 17650 heartbeater.cc:511] Master 127.16.155.62:40855 requested a full tablet report, sending...
I20240501 19:57:01.887560 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:01.887738 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:01.887778 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:01.887801 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593421887800 us; error 0 us; skew 500 ppm
I20240501 19:57:01.888099 17521 ts_manager.cc:194] Registered new tserver with Master: 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353)
I20240501 19:57:01.888741 17004 webserver.cc:460] Webserver started at http://127.16.155.2:41021/ using document root <none> and password file <none>
I20240501 19:57:01.888911 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:01.888971 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:01.889052 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:01.889042 17521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48732
I20240501 19:57:01.889663 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-1-root/instance:
uuid: "497b88e05cf04480b2942cdc2ae14525"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.891086 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.891914 17662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.892169 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.892233 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
uuid: "497b88e05cf04480b2942cdc2ae14525"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.892288 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:01.903103 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:01.903406 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:01.903657 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:01.904109 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:01.904160 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.904194 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:01.904227 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.908166 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.2:41883
I20240501 19:57:01.908247 17725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.2:41883 every 8 connection(s)
I20240501 19:57:01.908978 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:01.911731 17730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:01.912321 17729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.913086 17726 heartbeater.cc:347] Connected to a master server at 127.16.155.62:40855
W20240501 19:57:01.913120 17732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:01.913198 17726 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:01.913388 17726 heartbeater.cc:511] Master 127.16.155.62:40855 requested a full tablet report, sending...
I20240501 19:57:01.913873 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:01.914031 17521 ts_manager.cc:194] Registered new tserver with Master: 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:01.914072 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:01.914120 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:01.914152 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593421914152 us; error 0 us; skew 500 ppm
I20240501 19:57:01.914674 17521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48746
I20240501 19:57:01.915254 17004 webserver.cc:460] Webserver started at http://127.16.155.3:37563/ using document root <none> and password file <none>
I20240501 19:57:01.915411 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:01.915463 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:01.915542 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:01.915912 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-2-root/instance:
uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.917322 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:01.918279 17737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.918501 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.918573 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
format_stamp: "Formatted at 2024-05-01 19:57:01 on dist-test-slave-4377"
I20240501 19:57:01.918645 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714593394928573-17004-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:01.938843 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:01.939251 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:01.939549 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:01.939968 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:01.940011 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.940068 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:01.940099 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:01.944770 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.3:41785
I20240501 19:57:01.944849 17800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.3:41785 every 8 connection(s)
I20240501 19:57:01.948990 17801 heartbeater.cc:347] Connected to a master server at 127.16.155.62:40855
I20240501 19:57:01.949080 17801 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:01.949272 17801 heartbeater.cc:511] Master 127.16.155.62:40855 requested a full tablet report, sending...
I20240501 19:57:01.949823 17521 ts_manager.cc:194] Registered new tserver with Master: 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:01.950299 17521 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48754
I20240501 19:57:01.950820 17004 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005609743s
I20240501 19:57:01.951293 17004 test_util.cc:268] Using random seed: -472284867
I20240501 19:57:01.958360 17521 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48760:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 19:57:01.958988 17521 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 19:57:01.971617 17608 tablet_service.cc:1467] Processing CreateTablet for tablet a1ff206c89944948a0505cea312c4cd5 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 19:57:01.971743 17614 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae80af4481549c1837ebc036b9a9dc9 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 19:57:01.971966 17608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ff206c89944948a0505cea312c4cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.972198 17613 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6e8fe648aa4f34b3551d1ee48b425a (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 19:57:01.972435 17613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6e8fe648aa4f34b3551d1ee48b425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.972448 17690 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae80af4481549c1837ebc036b9a9dc9 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 19:57:01.972682 17690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae80af4481549c1837ebc036b9a9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.974308 17816 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:01.974435 17612 tablet_service.cc:1467] Processing CreateTablet for tablet ae1b7b6cf9974c4fb804dc56f035b96c (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 19:57:01.974498 17606 tablet_service.cc:1467] Processing CreateTablet for tablet f93c89e5d8df4fab9f2a8d3706cf1e12 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 19:57:01.974658 17612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1b7b6cf9974c4fb804dc56f035b96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.974910 17605 tablet_service.cc:1467] Processing CreateTablet for tablet eaee10322b5146c1afb1a1ad7f75eaff (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 19:57:01.975176 17605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaee10322b5146c1afb1a1ad7f75eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.975286 17816 tablet_bootstrap.cc:654] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.975390 17687 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6f020469f4043a376e2b48850134f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 19:57:01.975615 17687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6f020469f4043a376e2b48850134f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.976523 17611 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6f020469f4043a376e2b48850134f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 19:57:01.976703 17611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6f020469f4043a376e2b48850134f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.974910 17689 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6e8fe648aa4f34b3551d1ee48b425a (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 19:57:01.977458 17689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6e8fe648aa4f34b3551d1ee48b425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.977661 17686 tablet_service.cc:1467] Processing CreateTablet for tablet 44b583571b924c029dc2321c777bfba0 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 19:57:01.977777 17681 tablet_service.cc:1467] Processing CreateTablet for tablet eaee10322b5146c1afb1a1ad7f75eaff (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 19:57:01.977888 17686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44b583571b924c029dc2321c777bfba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.978027 17681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaee10322b5146c1afb1a1ad7f75eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.975116 17688 tablet_service.cc:1467] Processing CreateTablet for tablet ae1b7b6cf9974c4fb804dc56f035b96c (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 19:57:01.978331 17688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1b7b6cf9974c4fb804dc56f035b96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.978507 17610 tablet_service.cc:1467] Processing CreateTablet for tablet 44b583571b924c029dc2321c777bfba0 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 19:57:01.978744 17610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44b583571b924c029dc2321c777bfba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.979997 17682 tablet_service.cc:1467] Processing CreateTablet for tablet f93c89e5d8df4fab9f2a8d3706cf1e12 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 19:57:01.980139 17606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93c89e5d8df4fab9f2a8d3706cf1e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.980253 17682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93c89e5d8df4fab9f2a8d3706cf1e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.980731 17609 tablet_service.cc:1467] Processing CreateTablet for tablet 5d63f2f1d9884a7c86ef67092d585a0f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 19:57:01.980962 17609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d63f2f1d9884a7c86ef67092d585a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.982280 17683 tablet_service.cc:1467] Processing CreateTablet for tablet c6c297a715424322b2ae6290aaa8262d (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 19:57:01.982532 17683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c297a715424322b2ae6290aaa8262d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.982946 17607 tablet_service.cc:1467] Processing CreateTablet for tablet c6c297a715424322b2ae6290aaa8262d (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 19:57:01.983172 17607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c297a715424322b2ae6290aaa8262d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.983861 17816 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:01.983959 17816 ts_tablet_manager.cc:1367] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240501 19:57:01.984043 17765 tablet_service.cc:1467] Processing CreateTablet for tablet 5ae80af4481549c1837ebc036b9a9dc9 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 19:57:01.984268 17765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae80af4481549c1837ebc036b9a9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.984417 17816 raft_consensus.cc:348] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:01.984531 17684 tablet_service.cc:1467] Processing CreateTablet for tablet a1ff206c89944948a0505cea312c4cd5 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 19:57:01.984777 17756 tablet_service.cc:1467] Processing CreateTablet for tablet eaee10322b5146c1afb1a1ad7f75eaff (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 19:57:01.984848 17684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ff206c89944948a0505cea312c4cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.985011 17756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaee10322b5146c1afb1a1ad7f75eaff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.985041 17614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ae80af4481549c1837ebc036b9a9dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.985702 17685 tablet_service.cc:1467] Processing CreateTablet for tablet 5d63f2f1d9884a7c86ef67092d585a0f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 19:57:01.985940 17685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d63f2f1d9884a7c86ef67092d585a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.986886 17819 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:01.987300 17757 tablet_service.cc:1467] Processing CreateTablet for tablet f93c89e5d8df4fab9f2a8d3706cf1e12 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 19:57:01.987525 17757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f93c89e5d8df4fab9f2a8d3706cf1e12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.988514 17819 tablet_bootstrap.cc:654] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.988972 17817 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:01.989217 17764 tablet_service.cc:1467] Processing CreateTablet for tablet 1b6e8fe648aa4f34b3551d1ee48b425a (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 19:57:01.989573 17763 tablet_service.cc:1467] Processing CreateTablet for tablet ae1b7b6cf9974c4fb804dc56f035b96c (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 19:57:01.989660 17764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b6e8fe648aa4f34b3551d1ee48b425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.989809 17763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae1b7b6cf9974c4fb804dc56f035b96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.989923 17817 tablet_bootstrap.cc:654] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.990183 17758 tablet_service.cc:1467] Processing CreateTablet for tablet c6c297a715424322b2ae6290aaa8262d (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 19:57:01.990409 17758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c297a715424322b2ae6290aaa8262d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.991600 17762 tablet_service.cc:1467] Processing CreateTablet for tablet 47e6f020469f4043a376e2b48850134f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 19:57:01.991827 17762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47e6f020469f4043a376e2b48850134f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.992204 17817 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:01.992275 17817 ts_tablet_manager.cc:1367] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:01.992637 17759 tablet_service.cc:1467] Processing CreateTablet for tablet a1ff206c89944948a0505cea312c4cd5 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 19:57:01.992733 17817 raft_consensus.cc:348] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:01.992821 17759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1ff206c89944948a0505cea312c4cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.992836 17817 raft_consensus.cc:374] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:01.992875 17817 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:01.993027 17817 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:01.993407 17817 ts_tablet_manager.cc:1398] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.993432 17726 heartbeater.cc:503] Master 127.16.155.62:40855 was elected leader, sending a full tablet report...
I20240501 19:57:01.993594 17817 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:01.994069 17761 tablet_service.cc:1467] Processing CreateTablet for tablet 44b583571b924c029dc2321c777bfba0 (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 19:57:01.994302 17761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44b583571b924c029dc2321c777bfba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.994524 17817 tablet_bootstrap.cc:654] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.989625 17819 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:01.995011 17819 ts_tablet_manager.cc:1367] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240501 19:57:01.995491 17819 raft_consensus.cc:348] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:01.995594 17819 raft_consensus.cc:374] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:01.995623 17819 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:01.995774 17819 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:01.996083 17760 tablet_service.cc:1467] Processing CreateTablet for tablet 5d63f2f1d9884a7c86ef67092d585a0f (DEFAULT_TABLE table=test-workload [id=55dd415304fe497ea54ad3b59a84801e]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 19:57:01.996212 17819 ts_tablet_manager.cc:1398] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.996294 17760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d63f2f1d9884a7c86ef67092d585a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:01.996381 17819 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:01.996495 17801 heartbeater.cc:503] Master 127.16.155.62:40855 was elected leader, sending a full tablet report...
I20240501 19:57:01.997123 17817 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:01.997196 17817 ts_tablet_manager.cc:1367] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:01.997635 17817 raft_consensus.cc:348] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:01.997725 17817 raft_consensus.cc:374] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:01.997757 17817 raft_consensus.cc:729] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:01.997851 17817 consensus_queue.cc:260] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:01.997980 17819 tablet_bootstrap.cc:654] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:01.998144 17817 ts_tablet_manager.cc:1398] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:01.998298 17817 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:01.999209 17817 tablet_bootstrap.cc:654] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.000128 17819 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.000257 17819 ts_tablet_manager.cc:1367] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 19:57:01.984532 17816 raft_consensus.cc:374] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.000449 17816 raft_consensus.cc:729] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.000604 17816 consensus_queue.cc:260] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.000689 17819 raft_consensus.cc:348] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.000799 17819 raft_consensus.cc:374] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.000849 17819 raft_consensus.cc:729] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.000957 17816 ts_tablet_manager.cc:1398] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20240501 19:57:02.000994 17819 consensus_queue.cc:260] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.001119 17650 heartbeater.cc:503] Master 127.16.155.62:40855 was elected leader, sending a full tablet report...
I20240501 19:57:02.001636 17819 ts_tablet_manager.cc:1398] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:02.001806 17819 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.002627 17819 tablet_bootstrap.cc:654] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.003257 17816 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.003635 17819 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.003731 17819 ts_tablet_manager.cc:1367] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:02.004137 17819 raft_consensus.cc:348] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.004351 17819 raft_consensus.cc:374] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.004392 17819 raft_consensus.cc:729] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.004525 17819 consensus_queue.cc:260] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.004622 17816 tablet_bootstrap.cc:654] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.004817 17819 ts_tablet_manager.cc:1398] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:02.005021 17819 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.005103 17817 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.005190 17817 ts_tablet_manager.cc:1367] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240501 19:57:02.005651 17817 raft_consensus.cc:348] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.005739 17816 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.005789 17817 raft_consensus.cc:374] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.005826 17817 raft_consensus.cc:729] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.005860 17816 ts_tablet_manager.cc:1367] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:02.005945 17817 consensus_queue.cc:260] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.006206 17817 ts_tablet_manager.cc:1398] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.006278 17816 raft_consensus.cc:348] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.006359 17817 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.006367 17816 raft_consensus.cc:374] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.006456 17816 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.006573 17816 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.006831 17816 ts_tablet_manager.cc:1398] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:02.006990 17816 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.007171 17819 tablet_bootstrap.cc:654] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.007362 17817 tablet_bootstrap.cc:654] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.007933 17816 tablet_bootstrap.cc:654] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.008198 17819 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.008287 17819 ts_tablet_manager.cc:1367] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:02.008464 17817 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.008558 17817 ts_tablet_manager.cc:1367] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:02.008719 17819 raft_consensus.cc:348] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.008805 17819 raft_consensus.cc:374] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.008843 17819 raft_consensus.cc:729] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.008966 17817 raft_consensus.cc:348] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.009085 17817 raft_consensus.cc:374] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.009121 17817 raft_consensus.cc:729] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.009241 17817 consensus_queue.cc:260] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.009521 17817 ts_tablet_manager.cc:1398] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.009581 17816 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.008949 17819 consensus_queue.cc:260] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.009673 17816 ts_tablet_manager.cc:1367] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 19:57:02.009829 17819 ts_tablet_manager.cc:1398] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:02.009970 17819 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.009680 17817 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.010401 17816 raft_consensus.cc:348] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.010507 17816 raft_consensus.cc:374] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.010547 17816 raft_consensus.cc:729] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.010646 17816 consensus_queue.cc:260] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.010876 17817 tablet_bootstrap.cc:654] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.010876 17819 tablet_bootstrap.cc:654] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.010928 17816 ts_tablet_manager.cc:1398] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:02.011108 17816 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.012015 17816 tablet_bootstrap.cc:654] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.012611 17817 tablet_bootstrap.cc:492] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.012717 17817 ts_tablet_manager.cc:1367] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:02.012790 17819 tablet_bootstrap.cc:492] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.012866 17819 ts_tablet_manager.cc:1367] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:02.013067 17817 raft_consensus.cc:348] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.013145 17817 raft_consensus.cc:374] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.013166 17817 raft_consensus.cc:729] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.013258 17817 consensus_queue.cc:260] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.013309 17819 raft_consensus.cc:348] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.013407 17819 raft_consensus.cc:374] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.013442 17819 raft_consensus.cc:729] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.013501 17817 ts_tablet_manager.cc:1398] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.013581 17819 consensus_queue.cc:260] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.013681 17817 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.014155 17819 ts_tablet_manager.cc:1398] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.014331 17819 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.014597 17817 tablet_bootstrap.cc:654] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.015290 17819 tablet_bootstrap.cc:654] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.015648 17817 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.015697 17816 tablet_bootstrap.cc:492] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.015730 17817 ts_tablet_manager.cc:1367] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:02.015786 17816 ts_tablet_manager.cc:1367] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240501 19:57:02.016139 17817 raft_consensus.cc:348] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.016240 17817 raft_consensus.cc:374] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.016287 17817 raft_consensus.cc:729] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.016312 17819 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.016382 17819 ts_tablet_manager.cc:1367] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:02.016412 17817 consensus_queue.cc:260] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.016683 17817 ts_tablet_manager.cc:1398] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.016784 17819 raft_consensus.cc:348] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.016247 17816 raft_consensus.cc:348] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.016983 17816 raft_consensus.cc:374] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.017025 17816 raft_consensus.cc:729] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.017150 17816 consensus_queue.cc:260] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.016871 17817 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.017402 17816 ts_tablet_manager.cc:1398] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 19:57:02.017603 17816 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.018153 17817 tablet_bootstrap.cc:654] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.018483 17816 tablet_bootstrap.cc:654] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.016871 17819 raft_consensus.cc:374] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.018877 17819 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.019032 17819 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.019284 17819 ts_tablet_manager.cc:1398] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:02.019459 17816 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.019503 17817 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.019630 17816 ts_tablet_manager.cc:1367] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:02.019773 17817 ts_tablet_manager.cc:1367] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:02.019459 17819 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.020109 17816 raft_consensus.cc:348] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.020217 17816 raft_consensus.cc:374] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.020262 17816 raft_consensus.cc:729] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.020364 17817 raft_consensus.cc:348] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.020383 17816 consensus_queue.cc:260] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.020524 17817 raft_consensus.cc:374] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.020648 17817 raft_consensus.cc:729] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.020762 17816 ts_tablet_manager.cc:1398] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:02.020921 17816 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.020963 17819 tablet_bootstrap.cc:654] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.020871 17817 consensus_queue.cc:260] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.021592 17817 ts_tablet_manager.cc:1398] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.021803 17817 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.021868 17816 tablet_bootstrap.cc:654] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.022812 17817 tablet_bootstrap.cc:654] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.022984 17816 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.023078 17816 ts_tablet_manager.cc:1367] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:02.023159 17819 tablet_bootstrap.cc:492] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.023253 17819 ts_tablet_manager.cc:1367] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240501 19:57:02.023540 17816 raft_consensus.cc:348] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.023633 17816 raft_consensus.cc:374] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.023669 17816 raft_consensus.cc:729] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.023662 17819 raft_consensus.cc:348] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.023775 17819 raft_consensus.cc:374] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.023813 17816 consensus_queue.cc:260] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.024070 17816 ts_tablet_manager.cc:1398] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.024232 17816 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.023818 17819 raft_consensus.cc:729] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.024591 17819 consensus_queue.cc:260] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.024842 17819 ts_tablet_manager.cc:1398] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:02.025009 17819 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.025135 17816 tablet_bootstrap.cc:654] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.026015 17819 tablet_bootstrap.cc:654] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.026079 17816 tablet_bootstrap.cc:492] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.026173 17816 ts_tablet_manager.cc:1367] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.026533 17816 raft_consensus.cc:348] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.026695 17816 raft_consensus.cc:374] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.026741 17816 raft_consensus.cc:729] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.026887 17816 consensus_queue.cc:260] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.027004 17819 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.027082 17819 ts_tablet_manager.cc:1367] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:02.027415 17817 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.027503 17817 ts_tablet_manager.cc:1367] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:02.027494 17819 raft_consensus.cc:348] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.027601 17819 raft_consensus.cc:374] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.027635 17819 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.027736 17819 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.028005 17819 ts_tablet_manager.cc:1398] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:02.028048 17817 raft_consensus.cc:348] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.028153 17817 raft_consensus.cc:374] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.028173 17819 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.028424 17816 ts_tablet_manager.cc:1398] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.028191 17817 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.028782 17817 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.029071 17819 tablet_bootstrap.cc:654] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.029088 17817 ts_tablet_manager.cc:1398] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.029258 17817 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.029819 17816 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.030339 17817 tablet_bootstrap.cc:654] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.030479 17816 tablet_bootstrap.cc:654] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.031514 17819 tablet_bootstrap.cc:492] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.031586 17817 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.031600 17819 ts_tablet_manager.cc:1367] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:02.031680 17817 ts_tablet_manager.cc:1367] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:02.032029 17816 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.032099 17816 ts_tablet_manager.cc:1367] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.032058 17817 raft_consensus.cc:348] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.032171 17817 raft_consensus.cc:374] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.032058 17819 raft_consensus.cc:348] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.032205 17817 raft_consensus.cc:729] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.032222 17819 raft_consensus.cc:374] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.032256 17819 raft_consensus.cc:729] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.032315 17817 consensus_queue.cc:260] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.032356 17819 consensus_queue.cc:260] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.032512 17816 raft_consensus.cc:348] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.032578 17819 ts_tablet_manager.cc:1398] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:02.032596 17817 ts_tablet_manager.cc:1398] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.032610 17816 raft_consensus.cc:374] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.032678 17816 raft_consensus.cc:729] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.032740 17819 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Bootstrap starting.
I20240501 19:57:02.032791 17817 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: Bootstrap starting.
I20240501 19:57:02.032780 17816 consensus_queue.cc:260] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.033085 17816 ts_tablet_manager.cc:1398] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.033247 17816 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.033679 17819 tablet_bootstrap.cc:654] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.033679 17817 tablet_bootstrap.cc:654] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.035571 17816 tablet_bootstrap.cc:654] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.036072 17819 tablet_bootstrap.cc:492] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: No bootstrap required, opened a new log
I20240501 19:57:02.036163 17819 ts_tablet_manager.cc:1367] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:02.036587 17816 tablet_bootstrap.cc:492] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.036587 17817 tablet_bootstrap.cc:492] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: No bootstrap required, opened a new log
I20240501 19:57:02.036697 17816 ts_tablet_manager.cc:1367] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:02.036638 17819 raft_consensus.cc:348] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.036782 17819 raft_consensus.cc:374] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.036828 17819 raft_consensus.cc:729] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.036952 17819 consensus_queue.cc:260] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.037118 17816 raft_consensus.cc:348] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.037184 17819 ts_tablet_manager.cc:1398] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.037237 17816 raft_consensus.cc:374] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.037281 17816 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.037389 17816 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.036697 17817 ts_tablet_manager.cc:1367] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:02.037693 17816 ts_tablet_manager.cc:1398] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:02.037850 17816 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: Bootstrap starting.
I20240501 19:57:02.038013 17817 raft_consensus.cc:348] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.038110 17817 raft_consensus.cc:374] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.038142 17817 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.038256 17817 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.038511 17817 ts_tablet_manager.cc:1398] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:02.038558 17816 tablet_bootstrap.cc:654] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:02.039708 17816 tablet_bootstrap.cc:492] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: No bootstrap required, opened a new log
I20240501 19:57:02.039770 17816 ts_tablet_manager.cc:1367] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:02.040056 17816 raft_consensus.cc:348] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.040125 17816 raft_consensus.cc:374] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:02.040145 17816 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Initialized, Role: FOLLOWER
I20240501 19:57:02.040253 17816 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.040489 17816 ts_tablet_manager.cc:1398] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:02.086185 17822 raft_consensus.cc:482] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.086338 17822 raft_consensus.cc:504] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.086885 17822 leader_election.cc:288] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.089051 17822 raft_consensus.cc:482] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.089154 17822 raft_consensus.cc:504] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.089550 17822 leader_election.cc:288] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.090938 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.091110 17775 raft_consensus.cc:2454] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.090939 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.091311 17774 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.091442 17666 leader_election.cc:302] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.091629 17822 raft_consensus.cc:2781] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.091637 17624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.091681 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.091797 17623 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.091707 17822 raft_consensus.cc:482] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.091816 17624 raft_consensus.cc:2454] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.091873 17822 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.092101 17664 leader_election.cc:302] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.092396 17853 raft_consensus.cc:2781] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.092450 17853 raft_consensus.cc:482] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.092517 17853 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.092909 17822 raft_consensus.cc:504] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.093252 17822 leader_election.cc:288] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.093416 17853 raft_consensus.cc:504] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.093541 17624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.093541 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.093677 17774 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.093677 17624 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.093808 17853 leader_election.cc:288] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.094080 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.094180 17623 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.094623 17624 raft_consensus.cc:2454] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.094623 17774 raft_consensus.cc:2454] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.094898 17664 leader_election.cc:302] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.094942 17623 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.094991 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.095085 17774 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.095182 17664 leader_election.cc:302] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.095208 17853 raft_consensus.cc:2781] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.095345 17822 raft_consensus.cc:2781] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.095423 17853 raft_consensus.cc:686] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.095542 17822 raft_consensus.cc:686] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.095602 17853 consensus_queue.cc:237] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.095685 17822 consensus_queue.cc:237] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.095876 17774 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.097193 17521 catalog_manager.cc:5484] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.100107 17521 catalog_manager.cc:5484] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.191367 17855 raft_consensus.cc:482] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.191509 17855 raft_consensus.cc:504] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.191955 17855 leader_election.cc:288] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.192346 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.192346 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.192502 17774 raft_consensus.cc:2454] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.192502 17623 raft_consensus.cc:2454] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.192817 17666 leader_election.cc:302] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.193008 17855 raft_consensus.cc:2781] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.193073 17855 raft_consensus.cc:482] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.193130 17855 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.194118 17855 raft_consensus.cc:504] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.194420 17855 leader_election.cc:288] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.194675 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.194718 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.194802 17623 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.194809 17774 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.195482 17774 raft_consensus.cc:2454] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.195497 17623 raft_consensus.cc:2454] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.195752 17664 leader_election.cc:302] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.195927 17855 raft_consensus.cc:2781] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.196017 17855 raft_consensus.cc:686] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.196156 17855 consensus_queue.cc:237] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.197639 17521 catalog_manager.cc:5484] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.215046 17824 raft_consensus.cc:482] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.215173 17824 raft_consensus.cc:504] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.215634 17824 leader_election.cc:288] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:02.219174 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.219184 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525" is_pre_election: true
I20240501 19:57:02.219326 17623 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 0.
I20240501 19:57:02.219329 17700 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 0.
I20240501 19:57:02.219650 17739 leader_election.cc:302] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.219803 17824 raft_consensus.cc:2781] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.219870 17824 raft_consensus.cc:482] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.219898 17824 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.220695 17824 raft_consensus.cc:504] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.221005 17824 leader_election.cc:288] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:02.221271 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.221282 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.221390 17623 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.221418 17700 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.222060 17623 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 1.
I20240501 19:57:02.222303 17739 leader_election.cc:302] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.222453 17824 raft_consensus.cc:2781] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.222512 17700 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 1.
I20240501 19:57:02.222671 17824 raft_consensus.cc:686] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:02.222847 17824 consensus_queue.cc:237] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.224505 17521 catalog_manager.cc:5484] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:02.234153 17855 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.234261 17855 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.234592 17855 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.234889 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.234889 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.235044 17774 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.235090 17623 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.235283 17666 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.235468 17855 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.235520 17855 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.235546 17855 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.236264 17855 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.236563 17855 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.236817 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.236846 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.236903 17623 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.236960 17774 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.237615 17623 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.237648 17774 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.237875 17664 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.238041 17855 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.238122 17855 raft_consensus.cc:686] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.238250 17855 consensus_queue.cc:237] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.239547 17521 catalog_manager.cc:5484] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:02.259204 17827 raft_consensus.cc:482] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.259326 17827 raft_consensus.cc:504] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.259769 17827 leader_election.cc:288] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.262992 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44b583571b924c029dc2321c777bfba0" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525" is_pre_election: true
I20240501 19:57:02.263130 17700 raft_consensus.cc:2454] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.263253 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44b583571b924c029dc2321c777bfba0" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.263365 17774 raft_consensus.cc:2454] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.263402 17590 leader_election.cc:302] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.263545 17827 raft_consensus.cc:2781] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.263604 17827 raft_consensus.cc:482] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.263651 17827 raft_consensus.cc:3037] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.264449 17827 raft_consensus.cc:504] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.264735 17827 leader_election.cc:288] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.265012 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44b583571b924c029dc2321c777bfba0" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.265106 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44b583571b924c029dc2321c777bfba0" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.265113 17700 raft_consensus.cc:3037] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.265246 17774 raft_consensus.cc:3037] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.265910 17700 raft_consensus.cc:2454] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.266005 17774 raft_consensus.cc:2454] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.266184 17590 leader_election.cc:302] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.266340 17827 raft_consensus.cc:2781] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.266536 17827 raft_consensus.cc:686] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.266674 17827 consensus_queue.cc:237] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.268131 17521 catalog_manager.cc:5484] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.268560 17827 raft_consensus.cc:482] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.268643 17827 raft_consensus.cc:504] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.268929 17827 leader_election.cc:288] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.269217 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525" is_pre_election: true
I20240501 19:57:02.269217 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.269352 17774 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.269352 17700 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.269605 17590 leader_election.cc:302] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.269850 17827 raft_consensus.cc:2781] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.269909 17827 raft_consensus.cc:482] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.269948 17827 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.270644 17827 raft_consensus.cc:504] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.270879 17827 leader_election.cc:288] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.271163 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.271198 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.271283 17774 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.271282 17700 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.272069 17774 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.272069 17700 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.272356 17590 leader_election.cc:302] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.272500 17827 raft_consensus.cc:2781] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.272594 17827 raft_consensus.cc:686] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.272724 17827 consensus_queue.cc:237] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.274068 17521 catalog_manager.cc:5484] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.300938 17827 raft_consensus.cc:482] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.301087 17827 raft_consensus.cc:504] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.301497 17827 leader_election.cc:288] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.301877 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.301877 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525" is_pre_election: true
I20240501 19:57:02.302027 17774 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.302042 17700 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.302328 17590 leader_election.cc:302] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.302501 17827 raft_consensus.cc:2781] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.302561 17827 raft_consensus.cc:482] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.302697 17827 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.303508 17827 raft_consensus.cc:504] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.303789 17827 leader_election.cc:288] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.304128 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.304128 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.304257 17700 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.304257 17774 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.305078 17700 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.305078 17774 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.305377 17590 leader_election.cc:302] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.305545 17827 raft_consensus.cc:2781] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.305631 17827 raft_consensus.cc:686] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.305761 17827 consensus_queue.cc:237] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.307241 17521 catalog_manager.cc:5484] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.318570 17864 raft_consensus.cc:482] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.318681 17864 raft_consensus.cc:504] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.319038 17864 leader_election.cc:288] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.319357 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525" is_pre_election: true
I20240501 19:57:02.319420 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.319479 17700 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.319545 17774 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 0.
I20240501 19:57:02.319717 17590 leader_election.cc:302] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.319864 17864 raft_consensus.cc:2781] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.319917 17864 raft_consensus.cc:482] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.319967 17864 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.320776 17864 raft_consensus.cc:504] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.321038 17864 leader_election.cc:288] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.321301 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.321385 17700 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.321416 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.321554 17774 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.322108 17700 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.322204 17774 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 1.
I20240501 19:57:02.322453 17590 leader_election.cc:302] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.322599 17864 raft_consensus.cc:2781] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.322702 17864 raft_consensus.cc:686] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.322846 17864 consensus_queue.cc:237] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.324334 17521 catalog_manager.cc:5484] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.453817 17855 raft_consensus.cc:482] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:02.453963 17855 raft_consensus.cc:504] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.454370 17855 leader_election.cc:288] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.454748 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" is_pre_election: true
I20240501 19:57:02.454751 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711" is_pre_election: true
I20240501 19:57:02.454900 17774 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.454931 17623 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 0.
I20240501 19:57:02.455169 17666 leader_election.cc:302] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.455320 17855 raft_consensus.cc:2781] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:02.455376 17855 raft_consensus.cc:482] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:02.455401 17855 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.456190 17855 raft_consensus.cc:504] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.456529 17855 leader_election.cc:288] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.456802 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.456804 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.456950 17774 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.456967 17623 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:02.457680 17774 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.457731 17623 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 1.
I20240501 19:57:02.457948 17666 leader_election.cc:302] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.458120 17855 raft_consensus.cc:2781] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:02.458199 17855 raft_consensus.cc:686] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.458339 17855 consensus_queue.cc:237] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.459812 17521 catalog_manager.cc:5484] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.474591 17855 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.477245 17855 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.552667 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:02.552817 17700 raft_consensus.cc:595] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:02.554368 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:02.554482 17700 raft_consensus.cc:595] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:02.555847 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:02.555933 17700 raft_consensus.cc:595] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:02.557209 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "47e6f020469f4043a376e2b48850134f"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:02.557294 17700 raft_consensus.cc:595] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:02.562717 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:35958
I20240501 19:57:02.562811 17623 raft_consensus.cc:595] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Received request to transfer leadership to TS 497b88e05cf04480b2942cdc2ae14525
I20240501 19:57:02.564225 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:35958
I20240501 19:57:02.564337 17623 raft_consensus.cc:595] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Received request to transfer leadership to TS 497b88e05cf04480b2942cdc2ae14525
I20240501 19:57:02.568581 17774 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
mode: GRACEFUL
new_leader_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:33294
I20240501 19:57:02.568673 17774 raft_consensus.cc:595] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 LEADER]: Received request to transfer leadership to TS 497b88e05cf04480b2942cdc2ae14525
I20240501 19:57:02.570129 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:35958
I20240501 19:57:02.570219 17623 raft_consensus.cc:595] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Received request to transfer leadership to TS 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:02.599987 17855 consensus_queue.cc:1035] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.601778 17822 raft_consensus.cc:979] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.601871 17822 raft_consensus.cc:1067] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.602421 17624 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:02.602540 17624 raft_consensus.cc:482] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.602610 17624 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.603349 17855 consensus_queue.cc:1035] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.603727 17624 raft_consensus.cc:504] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.604113 17624 leader_election.cc:288] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.604586 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.604679 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b6e8fe648aa4f34b3551d1ee48b425a" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.604799 17700 raft_consensus.cc:3032] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.604846 17700 raft_consensus.cc:729] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.604971 17700 consensus_queue.cc:260] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.605124 17700 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.606058 17700 raft_consensus.cc:2454] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:02.606437 17590 leader_election.cc:302] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:02.606606 17864 raft_consensus.cc:2781] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.606711 17864 raft_consensus.cc:686] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.606839 17864 consensus_queue.cc:237] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.607933 17521 catalog_manager.cc:5484] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 1 to 2, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 2 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.655568 17855 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.657783 17822 raft_consensus.cc:979] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.657881 17822 raft_consensus.cc:1067] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.658535 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:02.658686 17623 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.658761 17623 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.659586 17853 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.659924 17623 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.660177 17624 raft_consensus.cc:1226] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Rejecting Update request from peer 497b88e05cf04480b2942cdc2ae14525 for earlier term 1. Current term is 2. Ops: []
I20240501 19:57:02.660370 17623 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Requested vote from peers 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:02.660858 17853 consensus_queue.cc:1046] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.661041 17855 raft_consensus.cc:3032] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.661070 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.661180 17855 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.661247 17775 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.661315 17855 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.661451 17855 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.661950 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.662328 17775 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:02.662479 17774 raft_consensus.cc:1226] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Rejecting Update request from peer 497b88e05cf04480b2942cdc2ae14525 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20240501 19:57:02.662667 17590 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.662850 17864 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.662928 17864 raft_consensus.cc:686] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.663048 17864 consensus_queue.cc:237] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:02.664235 17700 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:02.665876 17521 catalog_manager.cc:5484] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 1 to 2, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 2 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.670651 17855 consensus_queue.cc:1035] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.672123 17853 raft_consensus.cc:979] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.672214 17822 raft_consensus.cc:1067] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:02.672744 17624 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:02.672856 17624 raft_consensus.cc:482] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.672920 17624 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.673188 17822 consensus_queue.cc:1035] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.673924 17827 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.673952 17624 raft_consensus.cc:504] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.674304 17624 leader_election.cc:288] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.674556 17623 raft_consensus.cc:1226] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Rejecting Update request from peer 497b88e05cf04480b2942cdc2ae14525 for earlier term 1. Current term is 2. Ops: []
I20240501 19:57:02.674892 17855 consensus_queue.cc:1046] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.675033 17822 raft_consensus.cc:3032] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.675066 17773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.675123 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae1b7b6cf9974c4fb804dc56f035b96c" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.675101 17822 raft_consensus.cc:729] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.675361 17822 consensus_queue.cc:260] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.675506 17822 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.677008 17700 raft_consensus.cc:2454] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:02.677296 17590 leader_election.cc:302] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:02.677522 17827 raft_consensus.cc:2781] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.677701 17827 raft_consensus.cc:686] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.677842 17827 consensus_queue.cc:237] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.678274 17882 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.679369 17521 catalog_manager.cc:5484] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 1 to 2, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 2 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.679883 17827 raft_consensus.cc:979] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: : Instructing follower 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.679955 17827 raft_consensus.cc:1067] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Signalling peer 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.680711 17700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:60928
I20240501 19:57:02.680804 17700 raft_consensus.cc:482] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.680871 17700 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.681583 17700 raft_consensus.cc:504] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.681953 17700 leader_election.cc:288] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.682176 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.682264 17623 raft_consensus.cc:3032] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.682291 17623 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.682353 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.682399 17623 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.682456 17775 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.682554 17623 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.683101 17775 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.683190 17623 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.683382 17666 leader_election.cc:302] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:02.683550 17855 raft_consensus.cc:2781] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.683625 17855 raft_consensus.cc:686] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.683754 17855 consensus_queue.cc:237] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.684832 17518 catalog_manager.cc:5484] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 1 to 2, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.699477 17883 consensus_queue.cc:1035] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.702113 17827 consensus_queue.cc:1035] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.720746 17824 consensus_queue.cc:1035] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.723304 17888 consensus_queue.cc:1035] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.725345 17860 raft_consensus.cc:979] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: : Instructing follower 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.725442 17860 raft_consensus.cc:1067] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 LEADER]: Signalling peer 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.725889 17700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:60912
I20240501 19:57:02.726015 17700 raft_consensus.cc:482] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.726076 17700 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.726925 17700 raft_consensus.cc:504] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.727222 17700 leader_election.cc:288] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.727502 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.727568 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f93c89e5d8df4fab9f2a8d3706cf1e12" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.727600 17623 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.727692 17775 raft_consensus.cc:3032] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.727743 17775 raft_consensus.cc:729] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:02.727875 17775 consensus_queue.cc:260] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.727999 17775 raft_consensus.cc:3037] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.728441 17623 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.728664 17775 raft_consensus.cc:2454] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.728709 17664 leader_election.cc:302] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.728842 17855 raft_consensus.cc:2781] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.728906 17855 raft_consensus.cc:686] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.729041 17855 consensus_queue.cc:237] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.730194 17518 catalog_manager.cc:5484] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 1 to 2, leader changed from 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3) to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:02.841336 17882 consensus_queue.cc:1035] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.843158 17827 raft_consensus.cc:979] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: : Instructing follower 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:02.843259 17827 raft_consensus.cc:1067] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Signalling peer 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:02.843714 17774 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:33282
I20240501 19:57:02.844233 17883 consensus_queue.cc:1035] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.844399 17774 raft_consensus.cc:482] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.844493 17774 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.845613 17774 raft_consensus.cc:504] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.845988 17774 leader_election.cc:288] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 2 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:02.846378 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.846484 17623 raft_consensus.cc:3032] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.846527 17623 raft_consensus.cc:729] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.846650 17623 consensus_queue.cc:260] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.846720 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaee10322b5146c1afb1a1ad7f75eaff" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:02.846807 17623 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.846822 17700 raft_consensus.cc:3037] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.847725 17623 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 2.
I20240501 19:57:02.847729 17700 raft_consensus.cc:2454] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 2.
I20240501 19:57:02.847986 17739 leader_election.cc:302] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.848150 17860 raft_consensus.cc:2781] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.848242 17860 raft_consensus.cc:686] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:02.848379 17860 consensus_queue.cc:237] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.849421 17855 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.849946 17520 catalog_manager.cc:5484] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 1 to 2, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 2 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:02.852205 17855 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.862512 17883 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.864989 17883 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:02.866617 17882 raft_consensus.cc:979] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: : Instructing follower 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.866710 17882 raft_consensus.cc:1067] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Signalling peer 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:02.867134 17700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:60928
I20240501 19:57:02.867225 17700 raft_consensus.cc:482] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:02.867275 17700 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.867986 17700 raft_consensus.cc:504] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.868324 17700 leader_election.cc:288] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:02.868551 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:02.868661 17623 raft_consensus.cc:3032] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:02.868710 17623 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:02.868914 17623 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.869133 17623 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.869884 17623 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.868705 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:02.870106 17774 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:02.870147 17664 leader_election.cc:302] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:02.870290 17855 raft_consensus.cc:2781] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:02.870379 17855 raft_consensus.cc:686] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:02.870501 17855 consensus_queue.cc:237] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:02.870836 17774 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 2.
I20240501 19:57:02.871757 17518 catalog_manager.cc:5484] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 1 to 2, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 2 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:03.012709 17893 raft_consensus.cc:979] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:03.012820 17893 raft_consensus.cc:1067] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:03.013245 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "47e6f020469f4043a376e2b48850134f"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:03.013367 17623 raft_consensus.cc:482] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:03.013412 17623 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:03.014215 17623 raft_consensus.cc:504] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:03.014523 17623 leader_election.cc:288] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:03.014842 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:03.014879 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:03.014983 17700 raft_consensus.cc:3032] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:03.015007 17774 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:03.015039 17700 raft_consensus.cc:729] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:03.015197 17700 consensus_queue.cc:260] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:03.015347 17700 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:03.015923 17774 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:03.016199 17700 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:03.016216 17590 leader_election.cc:302] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:03.016417 17882 raft_consensus.cc:2781] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:03.016516 17882 raft_consensus.cc:686] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:03.016650 17882 consensus_queue.cc:237] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:03.017894 17518 catalog_manager.cc:5484] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 1 to 2, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 2 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:03.069525 17774 raft_consensus.cc:3037] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:03.070533 17774 raft_consensus.cc:1261] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.070950 17882 consensus_queue.cc:1035] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.072902 17700 raft_consensus.cc:1261] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.073323 17882 consensus_queue.cc:1035] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.140763 17774 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.141222 17882 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:03.143970 17700 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.144326 17882 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.182979 17623 raft_consensus.cc:1261] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.183454 17893 consensus_queue.cc:1035] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.186012 17774 raft_consensus.cc:1261] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.186372 17893 consensus_queue.cc:1035] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.191610 17774 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.191963 17893 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.194298 17623 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.194815 17822 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.195004 17774 raft_consensus.cc:3037] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:03.196022 17774 raft_consensus.cc:1261] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.196343 17827 consensus_queue.cc:1035] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.198573 17700 raft_consensus.cc:1261] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.199005 17882 consensus_queue.cc:1035] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.234553 17623 raft_consensus.cc:1261] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.234942 17860 consensus_queue.cc:1035] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.237129 17700 raft_consensus.cc:1261] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.237442 17860 consensus_queue.cc:1035] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.383396 17774 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.383869 17893 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.387008 17623 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.387370 17893 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.426223 17774 raft_consensus.cc:1261] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.426636 17864 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:03.428745 17700 raft_consensus.cc:1261] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:03.429109 17864 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:05.585516 17004 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240501 19:57:05.585681 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:05.590222 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:46400
I20240501 19:57:05.590373 17623 raft_consensus.cc:595] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Received request to transfer leadership to TS 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:05.594182 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:56088
I20240501 19:57:05.594306 17700 raft_consensus.cc:595] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Received request to transfer leadership to TS 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:05.594624 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 19:57:05.594707 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:05.906282 17864 raft_consensus.cc:979] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: : Instructing follower 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:05.906399 17864 raft_consensus.cc:1067] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Signalling peer 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:05.906832 17774 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:33282
I20240501 19:57:05.906987 17774 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:05.907059 17774 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:05.907881 17774 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:05.908246 17774 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 3 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:05.908547 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:05.908607 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:05.908666 17623 raft_consensus.cc:3032] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:57:05.908711 17623 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:05.908731 17700 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:05.908856 17623 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:05.909008 17623 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:05.909595 17700 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 3.
I20240501 19:57:05.909773 17623 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 3.
I20240501 19:57:05.909891 17741 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:05.910080 17899 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:57:05.910286 17899 raft_consensus.cc:686] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:05.910434 17899 consensus_queue.cc:237] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:05.911875 17520 catalog_manager.cc:5484] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 2 to 3, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 3 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:06.069782 17893 raft_consensus.cc:979] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:06.069888 17893 raft_consensus.cc:1067] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Signalling peer 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:06.070256 17774 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:33272
I20240501 19:57:06.070381 17774 raft_consensus.cc:482] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:06.070430 17774 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:06.071213 17774 raft_consensus.cc:504] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:06.071518 17774 leader_election.cc:288] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 3 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:06.071820 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:06.071836 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:06.071954 17623 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:06.071954 17700 raft_consensus.cc:3032] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:57:06.072060 17700 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:06.072196 17700 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:06.072356 17700 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:06.072981 17623 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 3.
I20240501 19:57:06.073263 17739 leader_election.cc:302] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:06.073284 17700 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 3.
I20240501 19:57:06.073442 17899 raft_consensus.cc:2781] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:57:06.073567 17899 raft_consensus.cc:686] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:06.073707 17899 consensus_queue.cc:237] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:06.075177 17520 catalog_manager.cc:5484] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 2 to 3, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 3 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:06.366526 17700 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:06.366945 17899 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:06.370060 17623 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:06.370429 17904 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:06.541312 17623 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:06.541750 17904 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:06.544113 17700 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:06.544482 17904 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:06.594996 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:06.595927 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:06.595995 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:07.596268 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:07.597187 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:07.597263 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:08.597568 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:08.598503 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:08.598574 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:09.598835 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:09.599745 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:09.599817 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:10.600077 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:10.601013 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:10.601102 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:11.601397 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:11.602355 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:11.602442 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:12.602680 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:12.603618 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:12.603689 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:13.604090 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:13.605412 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:13.605571 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:14.605876 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:14.606818 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:14.606899 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:15.614691 17004 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240501 19:57:15.615871 17774 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:33294
I20240501 19:57:15.616024 17774 raft_consensus.cc:595] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:15.620321 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:15.620435 17700 raft_consensus.cc:595] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:15.621857 17700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:60930
I20240501 19:57:15.621977 17700 raft_consensus.cc:595] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:15.623448 17774 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
mode: GRACEFUL
new_leader_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:33294
I20240501 19:57:15.623551 17774 raft_consensus.cc:595] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Received request to transfer leadership to TS 4de0dc200c734d0189121875be08d711
I20240501 19:57:15.645130 17904 raft_consensus.cc:979] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.645262 17904 raft_consensus.cc:1067] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.645757 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35954
I20240501 19:57:15.645884 17623 raft_consensus.cc:482] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:15.645962 17623 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.646946 17623 raft_consensus.cc:504] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.647330 17623 leader_election.cc:288] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 4 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:15.647652 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:15.647755 17700 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.647744 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c297a715424322b2ae6290aaa8262d" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:15.647917 17774 raft_consensus.cc:3032] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 19:57:15.647975 17774 raft_consensus.cc:729] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:15.648108 17774 consensus_queue.cc:260] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.648276 17774 raft_consensus.cc:3037] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.648669 17700 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 4.
I20240501 19:57:15.648960 17590 leader_election.cc:302] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:15.649001 17774 raft_consensus.cc:2454] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 4.
I20240501 19:57:15.649179 17921 raft_consensus.cc:2781] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 19:57:15.649271 17921 raft_consensus.cc:686] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:15.649408 17921 consensus_queue.cc:237] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.650887 17518 catalog_manager.cc:5484] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 3 to 4, leader changed from 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 4 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:15.852286 17920 raft_consensus.cc:979] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.852406 17920 raft_consensus.cc:1067] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.852855 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:15.853003 17623 raft_consensus.cc:482] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:15.853067 17623 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:15.853919 17623 raft_consensus.cc:504] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.854250 17623 leader_election.cc:288] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:15.854580 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:15.854579 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:15.854736 17774 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:15.854736 17700 raft_consensus.cc:3032] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 19:57:15.854820 17700 raft_consensus.cc:729] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:15.854976 17700 consensus_queue.cc:260] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.855147 17700 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Advancing to term 2
I20240501 19:57:15.855751 17774 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:15.856029 17590 leader_election.cc:302] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:15.856045 17700 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 2.
I20240501 19:57:15.856233 17921 raft_consensus.cc:2781] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 19:57:15.856343 17921 raft_consensus.cc:686] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:15.856487 17921 consensus_queue.cc:237] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:15.858078 17518 catalog_manager.cc:5484] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 1 to 2, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 2 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:15.965483 17924 raft_consensus.cc:979] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.965600 17924 raft_consensus.cc:1067] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:15.966004 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35954
I20240501 19:57:15.966133 17623 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:15.966198 17623 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.967025 17623 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:15.967360 17623 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 4 election: Requested vote from peers 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:15.967628 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:15.967700 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:15.967746 17774 raft_consensus.cc:3032] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 19:57:15.967772 17700 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.967799 17774 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:15.967957 17774 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:15.968119 17774 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:15.968713 17700 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 4.
I20240501 19:57:15.968962 17590 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:15.969043 17774 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 4.
I20240501 19:57:15.969134 17923 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 19:57:15.969228 17923 raft_consensus.cc:686] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:15.969362 17923 consensus_queue.cc:237] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:15.970816 17518 catalog_manager.cc:5484] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 3 to 4, leader changed from 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 4 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:16.046387 17930 raft_consensus.cc:979] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: : Instructing follower 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:16.046527 17930 raft_consensus.cc:1067] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Signalling peer 4de0dc200c734d0189121875be08d711 to start an election
I20240501 19:57:16.047006 17623 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "4de0dc200c734d0189121875be08d711"
from {username='slave'} at 127.0.0.1:35950
I20240501 19:57:16.047152 17623 raft_consensus.cc:482] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:16.047346 17623 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:16.048249 17623 raft_consensus.cc:504] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:16.048590 17623 leader_election.cc:288] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 3 election: Requested vote from peers 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:16.048910 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:16.048956 17774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "4de0dc200c734d0189121875be08d711" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:16.049021 17700 raft_consensus.cc:3032] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:57:16.049103 17700 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:16.049113 17774 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:16.049360 17700 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:16.049564 17700 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:16.050063 17774 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 3.
I20240501 19:57:16.050340 17590 leader_election.cc:302] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:16.050340 17700 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de0dc200c734d0189121875be08d711 in term 3.
I20240501 19:57:16.050590 17923 raft_consensus.cc:2781] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:57:16.050699 17923 raft_consensus.cc:686] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 LEADER]: Becoming Leader. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:16.050850 17923 consensus_queue.cc:237] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:16.052462 17518 catalog_manager.cc:5484] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 reported cstate change: term changed from 2 to 3, leader changed from 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2) to 4de0dc200c734d0189121875be08d711 (127.16.155.1). New cstate: current_term: 3 leader_uuid: "4de0dc200c734d0189121875be08d711" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:16.073494 17700 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:16.074010 17923 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:16.076560 17774 raft_consensus.cc:1261] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:16.077215 17936 consensus_queue.cc:1035] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:16.385546 17774 raft_consensus.cc:1261] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:16.385934 17936 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:16.388139 17700 raft_consensus.cc:1261] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 19:57:16.388471 17921 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:16.418792 17700 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:16.419193 17921 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:16.422919 17774 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:16.423296 17923 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:16.582888 17700 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:16.583374 17923 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:16.585803 17774 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Refusing update from remote peer 4de0dc200c734d0189121875be08d711: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:16.586160 17936 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:18.641284 17004 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240501 19:57:18.641507 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:18.643937 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "47e6f020469f4043a376e2b48850134f"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:46400
I20240501 19:57:18.644117 17623 raft_consensus.cc:595] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Received request to transfer leadership to TS 497b88e05cf04480b2942cdc2ae14525
I20240501 19:57:18.645085 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:46400
I20240501 19:57:18.645208 17623 raft_consensus.cc:595] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Received request to transfer leadership to TS 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:18.646133 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:46400
I20240501 19:57:18.646255 17623 raft_consensus.cc:595] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Received request to transfer leadership to TS 497b88e05cf04480b2942cdc2ae14525
I20240501 19:57:18.647078 17623 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "4de0dc200c734d0189121875be08d711"
mode: GRACEFUL
new_leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:46400
I20240501 19:57:18.647205 17623 raft_consensus.cc:595] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 LEADER]: Received request to transfer leadership to TS 1bfca6d374ef4fa19ddfd2c0cd8fa867
I20240501 19:57:18.647550 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240501 19:57:18.647699 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:18.928478 17948 raft_consensus.cc:979] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: : Instructing follower 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:18.928596 17948 raft_consensus.cc:1067] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Signalling peer 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:18.929114 17774 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:33282
I20240501 19:57:18.929260 17774 raft_consensus.cc:482] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:18.929322 17774 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Advancing to term 5
I20240501 19:57:18.930111 17774 raft_consensus.cc:504] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:18.930516 17774 leader_election.cc:288] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 5 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:18.930932 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:18.931042 17623 raft_consensus.cc:3032] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Stepping down as leader of term 4
I20240501 19:57:18.931087 17623 raft_consensus.cc:729] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:18.931212 17623 consensus_queue.cc:260] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:18.931375 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ae80af4481549c1837ebc036b9a9dc9" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:18.931483 17700 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Advancing to term 5
I20240501 19:57:18.932158 17700 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 5.
I20240501 19:57:18.932471 17741 leader_election.cc:302] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 497b88e05cf04480b2942cdc2ae14525; no voters:
I20240501 19:57:18.931375 17623 raft_consensus.cc:3037] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Advancing to term 5
I20240501 19:57:18.933261 17623 raft_consensus.cc:2454] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 5.
I20240501 19:57:18.933461 17947 raft_consensus.cc:2781] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 5 FOLLOWER]: Leader election won for term 5
I20240501 19:57:18.933665 17947 raft_consensus.cc:686] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 5 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:18.933775 17947 consensus_queue.cc:237] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } }
I20240501 19:57:18.935287 17520 catalog_manager.cc:5484] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 4 to 5, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 5 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:19.026119 17948 raft_consensus.cc:979] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: : Instructing follower 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:19.026257 17948 raft_consensus.cc:1067] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Signalling peer 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:19.026665 17700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:60928
I20240501 19:57:19.026818 17700 raft_consensus.cc:482] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:19.026883 17700 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.027735 17700 raft_consensus.cc:504] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.028169 17700 leader_election.cc:288] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 3 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:19.028476 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:19.028476 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d63f2f1d9884a7c86ef67092d585a0f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:19.028623 17623 raft_consensus.cc:3032] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:57:19.028666 17623 raft_consensus.cc:729] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:19.028698 17775 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.028898 17623 consensus_queue.cc:260] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.029052 17623 raft_consensus.cc:3037] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.029795 17623 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 3.
I20240501 19:57:19.029855 17775 raft_consensus.cc:2454] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 3.
I20240501 19:57:19.030074 17664 leader_election.cc:302] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:19.030263 17930 raft_consensus.cc:2781] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:57:19.030450 17930 raft_consensus.cc:686] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 3 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:19.030608 17930 consensus_queue.cc:237] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.032332 17520 catalog_manager.cc:5484] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 2 to 3, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:19.100313 17949 raft_consensus.cc:979] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: : Instructing follower 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:19.100428 17949 raft_consensus.cc:1067] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 LEADER]: Signalling peer 1bfca6d374ef4fa19ddfd2c0cd8fa867 to start an election
I20240501 19:57:19.100860 17775 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5"
dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
from {username='slave'} at 127.0.0.1:33282
I20240501 19:57:19.100987 17775 raft_consensus.cc:482] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:19.101075 17775 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:19.101943 17775 raft_consensus.cc:504] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.102298 17775 leader_election.cc:288] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 4 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2:41883)
I20240501 19:57:19.102634 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:19.102730 17623 raft_consensus.cc:3032] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 19:57:19.102681 17700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1ff206c89944948a0505cea312c4cd5" candidate_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
I20240501 19:57:19.102777 17623 raft_consensus.cc:729] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:19.102828 17700 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:19.102913 17623 consensus_queue.cc:260] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.103039 17623 raft_consensus.cc:3037] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Advancing to term 4
I20240501 19:57:19.103694 17623 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 4.
I20240501 19:57:19.103943 17739 leader_election.cc:302] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bfca6d374ef4fa19ddfd2c0cd8fa867, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:19.103958 17700 raft_consensus.cc:2454] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bfca6d374ef4fa19ddfd2c0cd8fa867 in term 4.
I20240501 19:57:19.104112 17950 raft_consensus.cc:2781] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 19:57:19.104197 17950 raft_consensus.cc:686] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 LEADER]: Becoming Leader. State: Replica: 1bfca6d374ef4fa19ddfd2c0cd8fa867, State: Running, Role: LEADER
I20240501 19:57:19.104338 17950 consensus_queue.cc:237] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.106187 17520 catalog_manager.cc:5484] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 reported cstate change: term changed from 3 to 4, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3). New cstate: current_term: 4 leader_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:19.138013 17948 raft_consensus.cc:979] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: : Instructing follower 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:19.138154 17948 raft_consensus.cc:1067] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Signalling peer 497b88e05cf04480b2942cdc2ae14525 to start an election
I20240501 19:57:19.138600 17700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "47e6f020469f4043a376e2b48850134f"
dest_uuid: "497b88e05cf04480b2942cdc2ae14525"
from {username='slave'} at 127.0.0.1:60928
I20240501 19:57:19.138731 17700 raft_consensus.cc:482] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 19:57:19.138798 17700 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.139583 17700 raft_consensus.cc:504] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.139899 17700 leader_election.cc:288] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 3 election: Requested vote from peers 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353), 1bfca6d374ef4fa19ddfd2c0cd8fa867 (127.16.155.3:41785)
I20240501 19:57:19.140210 17623 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4de0dc200c734d0189121875be08d711"
I20240501 19:57:19.140241 17775 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47e6f020469f4043a376e2b48850134f" candidate_uuid: "497b88e05cf04480b2942cdc2ae14525" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867"
I20240501 19:57:19.140339 17623 raft_consensus.cc:3032] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 19:57:19.140388 17623 raft_consensus.cc:729] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4de0dc200c734d0189121875be08d711, State: Running, Role: LEADER
I20240501 19:57:19.140424 17775 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.140537 17623 consensus_queue.cc:260] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.140688 17623 raft_consensus.cc:3037] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Advancing to term 3
I20240501 19:57:19.141367 17623 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 3.
I20240501 19:57:19.141625 17664 leader_election.cc:302] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 497b88e05cf04480b2942cdc2ae14525, 4de0dc200c734d0189121875be08d711; no voters:
I20240501 19:57:19.141649 17775 raft_consensus.cc:2454] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 497b88e05cf04480b2942cdc2ae14525 in term 3.
I20240501 19:57:19.141767 17930 raft_consensus.cc:2781] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 19:57:19.141853 17930 raft_consensus.cc:686] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 3 LEADER]: Becoming Leader. State: Replica: 497b88e05cf04480b2942cdc2ae14525, State: Running, Role: LEADER
I20240501 19:57:19.141968 17930 consensus_queue.cc:237] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } }
I20240501 19:57:19.143853 17520 catalog_manager.cc:5484] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 reported cstate change: term changed from 2 to 3, leader changed from 4de0dc200c734d0189121875be08d711 (127.16.155.1) to 497b88e05cf04480b2942cdc2ae14525 (127.16.155.2). New cstate: current_term: 3 leader_uuid: "497b88e05cf04480b2942cdc2ae14525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:19.347669 17623 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 5 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 19:57:19.348206 17947 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 19:57:19.350628 17700 raft_consensus.cc:1261] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 5 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 19:57:19.351110 17962 consensus_queue.cc:1035] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 19:57:19.427250 17623 raft_consensus.cc:1261] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:19.427675 17930 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:19.430202 17775 raft_consensus.cc:1261] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:19.430577 17967 consensus_queue.cc:1035] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:19.508028 17623 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:19.508442 17962 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:19.511739 17700 raft_consensus.cc:1261] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Refusing update from remote peer 1bfca6d374ef4fa19ddfd2c0cd8fa867: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 19:57:19.512087 17947 consensus_queue.cc:1035] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [LEADER]: Connected to new peer: Peer: permanent_uuid: "497b88e05cf04480b2942cdc2ae14525" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 41883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:19.528451 17775 raft_consensus.cc:1261] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:19.528832 17967 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bfca6d374ef4fa19ddfd2c0cd8fa867" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 41785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:19.531009 17623 raft_consensus.cc:1261] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Refusing update from remote peer 497b88e05cf04480b2942cdc2ae14525: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 19:57:19.531461 17967 consensus_queue.cc:1035] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de0dc200c734d0189121875be08d711" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 37353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:19.653717 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:19.654655 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:19.654735 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:20.655014 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:20.655946 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:20.656030 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:21.656363 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:21.657430 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:21.657529 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:22.657817 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:22.658963 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:22.659075 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:23.659404 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:23.660398 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:23.660477 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:24.660823 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:24.662113 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:24.662212 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:25.662464 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:25.663380 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:25.663456 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:26.663712 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:26.664605 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:26.664680 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:27.664988 17004 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 19:57:27.666030 17004 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 19:57:27.666113 17004 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 19:57:28.673656 17004 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240501 19:57:28.673796 17004 tablet_server.cc:178] TabletServer@127.16.155.1:0 shutting down...
I20240501 19:57:28.678124 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:28.678294 17004 tablet_replica.cc:330] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.678417 17004 raft_consensus.cc:2229] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.678534 17004 raft_consensus.cc:2258] T 5ae80af4481549c1837ebc036b9a9dc9 P 4de0dc200c734d0189121875be08d711 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.679107 17004 tablet_replica.cc:330] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.679237 17004 raft_consensus.cc:2229] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.679348 17004 raft_consensus.cc:2258] T 5d63f2f1d9884a7c86ef67092d585a0f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.679677 17004 tablet_replica.cc:330] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.679781 17004 raft_consensus.cc:2229] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.679875 17004 raft_consensus.cc:2258] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.680167 17004 tablet_replica.cc:330] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.680269 17004 raft_consensus.cc:2229] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.680359 17004 raft_consensus.cc:2258] T a1ff206c89944948a0505cea312c4cd5 P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.680646 17004 tablet_replica.cc:330] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.680755 17004 raft_consensus.cc:2229] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.680907 17004 raft_consensus.cc:2258] T 1b6e8fe648aa4f34b3551d1ee48b425a P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.681210 17004 tablet_replica.cc:330] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.681319 17004 raft_consensus.cc:2229] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 4 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.681504 17004 raft_consensus.cc:2258] T c6c297a715424322b2ae6290aaa8262d P 4de0dc200c734d0189121875be08d711 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.681814 17004 tablet_replica.cc:330] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.681913 17004 raft_consensus.cc:2229] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 1 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.682062 17004 raft_consensus.cc:2258] T 44b583571b924c029dc2321c777bfba0 P 4de0dc200c734d0189121875be08d711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.682349 17004 tablet_replica.cc:330] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.682444 17004 raft_consensus.cc:2229] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.682597 17004 raft_consensus.cc:2258] T ae1b7b6cf9974c4fb804dc56f035b96c P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.682883 17004 tablet_replica.cc:330] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.682981 17004 raft_consensus.cc:2229] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.683070 17004 raft_consensus.cc:2258] T eaee10322b5146c1afb1a1ad7f75eaff P 4de0dc200c734d0189121875be08d711 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.683342 17004 tablet_replica.cc:330] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711: stopping tablet replica
I20240501 19:57:28.683432 17004 raft_consensus.cc:2229] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.683521 17004 raft_consensus.cc:2258] T 47e6f020469f4043a376e2b48850134f P 4de0dc200c734d0189121875be08d711 [term 3 FOLLOWER]: Raft consensus is shut down!
W20240501 19:57:28.695577 17664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.16.155.1:37353: connect: Connection refused (error 111)
W20240501 19:57:28.696348 17664 consensus_peers.cc:485] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 -> Peer 4de0dc200c734d0189121875be08d711 (127.16.155.1:37353): Couldn't send request to peer 4de0dc200c734d0189121875be08d711. Status: Network error: Client connection negotiation failed: client connection to 127.16.155.1:37353: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:28.698570 17004 tablet_server.cc:194] TabletServer@127.16.155.1:0 shutdown complete.
I20240501 19:57:28.701877 17004 tablet_server.cc:178] TabletServer@127.16.155.2:0 shutting down...
I20240501 19:57:28.708469 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:28.708813 17004 tablet_replica.cc:330] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.708992 17004 raft_consensus.cc:2229] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.709153 17004 raft_consensus.cc:2258] T a1ff206c89944948a0505cea312c4cd5 P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.709656 17004 tablet_replica.cc:330] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.709748 17004 raft_consensus.cc:2229] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.709826 17004 raft_consensus.cc:2258] T c6c297a715424322b2ae6290aaa8262d P 497b88e05cf04480b2942cdc2ae14525 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.710106 17004 tablet_replica.cc:330] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.710180 17004 raft_consensus.cc:2229] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.710249 17004 raft_consensus.cc:2258] T 44b583571b924c029dc2321c777bfba0 P 497b88e05cf04480b2942cdc2ae14525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.710505 17004 tablet_replica.cc:330] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.710573 17004 raft_consensus.cc:2229] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.710701 17004 raft_consensus.cc:2258] T 47e6f020469f4043a376e2b48850134f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.710968 17004 tablet_replica.cc:330] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.711036 17004 raft_consensus.cc:2229] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.711107 17004 raft_consensus.cc:2258] T 5ae80af4481549c1837ebc036b9a9dc9 P 497b88e05cf04480b2942cdc2ae14525 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.711352 17004 tablet_replica.cc:330] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.711421 17004 raft_consensus.cc:2229] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.711488 17004 raft_consensus.cc:2258] T 1b6e8fe648aa4f34b3551d1ee48b425a P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.711721 17004 tablet_replica.cc:330] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.711789 17004 raft_consensus.cc:2229] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.711855 17004 raft_consensus.cc:2258] T eaee10322b5146c1afb1a1ad7f75eaff P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.712098 17004 tablet_replica.cc:330] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.712163 17004 raft_consensus.cc:2229] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.712229 17004 raft_consensus.cc:2258] T ae1b7b6cf9974c4fb804dc56f035b96c P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.712479 17004 tablet_replica.cc:330] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.712543 17004 raft_consensus.cc:2229] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 3 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.712663 17004 raft_consensus.cc:2258] T 5d63f2f1d9884a7c86ef67092d585a0f P 497b88e05cf04480b2942cdc2ae14525 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.712908 17004 tablet_replica.cc:330] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525: stopping tablet replica
I20240501 19:57:28.712994 17004 raft_consensus.cc:2229] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.713109 17004 raft_consensus.cc:2258] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 497b88e05cf04480b2942cdc2ae14525 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.727574 17004 tablet_server.cc:194] TabletServer@127.16.155.2:0 shutdown complete.
I20240501 19:57:28.730170 17004 tablet_server.cc:178] TabletServer@127.16.155.3:0 shutting down...
I20240501 19:57:28.734243 17004 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 19:57:28.734406 17004 tablet_replica.cc:330] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.734500 17004 raft_consensus.cc:2229] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.734651 17004 raft_consensus.cc:2258] T a1ff206c89944948a0505cea312c4cd5 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.735004 17004 tablet_replica.cc:330] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.735085 17004 raft_consensus.cc:2229] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.735157 17004 raft_consensus.cc:2258] T 47e6f020469f4043a376e2b48850134f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.735435 17004 tablet_replica.cc:330] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.735508 17004 raft_consensus.cc:2229] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.735631 17004 raft_consensus.cc:2258] T eaee10322b5146c1afb1a1ad7f75eaff P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.735879 17004 tablet_replica.cc:330] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.735946 17004 raft_consensus.cc:2229] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 5 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.736063 17004 raft_consensus.cc:2258] T 5ae80af4481549c1837ebc036b9a9dc9 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.736307 17004 tablet_replica.cc:330] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.736374 17004 raft_consensus.cc:2229] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.736440 17004 raft_consensus.cc:2258] T 5d63f2f1d9884a7c86ef67092d585a0f P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.736670 17004 tablet_replica.cc:330] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.736735 17004 raft_consensus.cc:2229] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.736793 17004 raft_consensus.cc:2258] T f93c89e5d8df4fab9f2a8d3706cf1e12 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.737035 17004 tablet_replica.cc:330] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.737097 17004 raft_consensus.cc:2229] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.737161 17004 raft_consensus.cc:2258] T ae1b7b6cf9974c4fb804dc56f035b96c P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.737386 17004 tablet_replica.cc:330] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.737449 17004 raft_consensus.cc:2229] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.737551 17004 raft_consensus.cc:2258] T 1b6e8fe648aa4f34b3551d1ee48b425a P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.737802 17004 tablet_replica.cc:330] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.737862 17004 raft_consensus.cc:2229] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.737926 17004 raft_consensus.cc:2258] T 44b583571b924c029dc2321c777bfba0 P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.738163 17004 tablet_replica.cc:330] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867: stopping tablet replica
I20240501 19:57:28.738224 17004 raft_consensus.cc:2229] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:28.738286 17004 raft_consensus.cc:2258] T c6c297a715424322b2ae6290aaa8262d P 1bfca6d374ef4fa19ddfd2c0cd8fa867 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.752401 17004 tablet_server.cc:194] TabletServer@127.16.155.3:0 shutdown complete.
I20240501 19:57:28.755383 17004 master.cc:537] Master@127.16.155.62:40855 shutting down...
I20240501 19:57:28.759145 17004 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 1 LEADER]: Raft consensus shutting down.
I20240501 19:57:28.759284 17004 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:28.759333 17004 tablet_replica.cc:330] T 00000000000000000000000000000000 P 758d00823581471294d60ad4a85ebfc4: stopping tablet replica
I20240501 19:57:28.772837 17004 master.cc:552] Master@127.16.155.62:40855 shutdown complete.
1bfca6d374ef4fa19ddfd2c0cd8fa867 1
497b88e05cf04480b2942cdc2ae14525 4
4de0dc200c734d0189121875be08d711 5
1bfca6d374ef4fa19ddfd2c0cd8fa867 3
497b88e05cf04480b2942cdc2ae14525 3
4de0dc200c734d0189121875be08d711 4
1bfca6d374ef4fa19ddfd2c0cd8fa867 1
497b88e05cf04480b2942cdc2ae14525 1
4de0dc200c734d0189121875be08d711 8
1bfca6d374ef4fa19ddfd2c0cd8fa867 3
497b88e05cf04480b2942cdc2ae14525 3
4de0dc200c734d0189121875be08d711 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (26997 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240501 19:57:28.784626 17004 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.16.155.62:38023
I20240501 19:57:28.784925 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:28.787153 17979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.788038 17976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.788497 17977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:28.789258 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:28.789419 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:28.789455 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:28.789541 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593448789539 us; error 0 us; skew 500 ppm
I20240501 19:57:28.790387 17004 webserver.cc:460] Webserver started at http://127.16.155.62:34685/ using document root <none> and password file <none>
I20240501 19:57:28.790535 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:28.790578 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:28.790635 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:28.790963 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/master-0-root/instance:
uuid: "9b2fc3a1199d48d49895e9daf0fa287f"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.792533 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:28.793514 17984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.793771 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:28.793846 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/master-0-root
uuid: "9b2fc3a1199d48d49895e9daf0fa287f"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.793920 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:28.811599 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:28.811967 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:28.815960 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.62:38023
I20240501 19:57:28.819681 18036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.62:38023 every 8 connection(s)
I20240501 19:57:28.820144 18037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.821969 18037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f: Bootstrap starting.
I20240501 19:57:28.822710 18037 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:28.823700 18037 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f: No bootstrap required, opened a new log
I20240501 19:57:28.824074 18037 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER }
I20240501 19:57:28.824163 18037 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:28.824196 18037 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b2fc3a1199d48d49895e9daf0fa287f, State: Initialized, Role: FOLLOWER
I20240501 19:57:28.824332 18037 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER }
I20240501 19:57:28.824401 18037 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 19:57:28.824450 18037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 19:57:28.824501 18037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:28.825125 18037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER }
I20240501 19:57:28.825246 18037 leader_election.cc:302] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b2fc3a1199d48d49895e9daf0fa287f; no voters:
I20240501 19:57:28.825413 18037 leader_election.cc:288] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 19:57:28.825549 18040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:28.825737 18040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [term 1 LEADER]: Becoming Leader. State: Replica: 9b2fc3a1199d48d49895e9daf0fa287f, State: Running, Role: LEADER
I20240501 19:57:28.825855 18037 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [sys.catalog]: configured and running, proceeding with master startup.
I20240501 19:57:28.825870 18040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER }
I20240501 19:57:28.826321 18041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER } }
I20240501 19:57:28.826365 18042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b2fc3a1199d48d49895e9daf0fa287f. Latest consensus state: current_term: 1 leader_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b2fc3a1199d48d49895e9daf0fa287f" member_type: VOTER } }
I20240501 19:57:28.826515 18042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [sys.catalog]: This master's current role is: LEADER
I20240501 19:57:28.826939 18041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f [sys.catalog]: This master's current role is: LEADER
I20240501 19:57:28.827652 17004 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20240501 19:57:28.828095 18056 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240501 19:57:28.828161 18056 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240501 19:57:28.828269 18047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 19:57:28.828859 18047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 19:57:28.830469 18047 catalog_manager.cc:1347] Generated new cluster ID: 9602639be06340cf9f9056d9961a81ef
I20240501 19:57:28.830526 18047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 19:57:28.839136 18047 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 19:57:28.839596 18047 catalog_manager.cc:1504] Loading token signing keys...
I20240501 19:57:28.849687 18047 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 9b2fc3a1199d48d49895e9daf0fa287f: Generated new TSK 0
I20240501 19:57:28.849833 18047 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 19:57:28.859827 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:28.862327 18058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.862890 18059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.863658 18061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:28.864362 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:28.864495 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:28.864532 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:28.864547 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593448864547 us; error 0 us; skew 500 ppm
I20240501 19:57:28.865463 17004 webserver.cc:460] Webserver started at http://127.16.155.1:41107/ using document root <none> and password file <none>
I20240501 19:57:28.865643 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:28.865687 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:28.865761 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:28.866119 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/instance:
uuid: "a7834062bf084f9cabbff4788a79d2a9"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.867516 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20240501 19:57:28.868346 18066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.868577 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:28.868646 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root
uuid: "a7834062bf084f9cabbff4788a79d2a9"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.868711 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:28.877645 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:28.877933 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:28.878180 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:28.878573 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:28.878612 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.878659 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:28.878685 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.882431 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.1:43571
I20240501 19:57:28.882467 18129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.1:43571 every 8 connection(s)
I20240501 19:57:28.883162 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:28.885648 18135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.886173 18134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.887096 18137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:28.887339 18130 heartbeater.cc:347] Connected to a master server at 127.16.155.62:38023
I20240501 19:57:28.887420 18130 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:28.887616 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:28.887662 18130 heartbeater.cc:511] Master 127.16.155.62:38023 requested a full tablet report, sending...
I20240501 19:57:28.887809 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:28.887857 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:28.887876 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593448887875 us; error 0 us; skew 500 ppm
I20240501 19:57:28.888326 18001 ts_manager.cc:194] Registered new tserver with Master: a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571)
I20240501 19:57:28.888765 17004 webserver.cc:460] Webserver started at http://127.16.155.2:35679/ using document root <none> and password file <none>
I20240501 19:57:28.888962 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:28.889015 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:28.889127 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:28.889293 18001 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34898
I20240501 19:57:28.889585 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/instance:
uuid: "d7ebf87da4c94e46a875293608ddad04"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.891086 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:28.891884 18142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.892099 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:28.892164 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root
uuid: "d7ebf87da4c94e46a875293608ddad04"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.892228 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:28.896566 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:28.896836 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:28.897068 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:28.897439 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:28.897505 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.897563 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:28.897598 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.901391 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.2:34865
I20240501 19:57:28.901417 18205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.2:34865 every 8 connection(s)
I20240501 19:57:28.902076 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 19:57:28.904531 18210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.905048 18209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:28.905725 18212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:28.905992 18206 heartbeater.cc:347] Connected to a master server at 127.16.155.62:38023
I20240501 19:57:28.906072 18206 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:28.906253 18206 heartbeater.cc:511] Master 127.16.155.62:38023 requested a full tablet report, sending...
I20240501 19:57:28.906479 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:28.906643 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:28.906697 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:28.906720 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593448906720 us; error 0 us; skew 500 ppm
I20240501 19:57:28.906908 18001 ts_manager.cc:194] Registered new tserver with Master: d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:28.907505 18001 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34912
I20240501 19:57:28.907600 17004 webserver.cc:460] Webserver started at http://127.16.155.3:38545/ using document root <none> and password file <none>
I20240501 19:57:28.907748 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:28.907795 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:28.907864 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:28.908282 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/instance:
uuid: "030d4bb74d5046d98e41d25d74fce3f5"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.909648 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:28.910526 18217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.910734 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:28.910799 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root
uuid: "030d4bb74d5046d98e41d25d74fce3f5"
format_stamp: "Formatted at 2024-05-01 19:57:28 on dist-test-slave-4377"
I20240501 19:57:28.910859 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:28.919905 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:28.920193 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:28.920424 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:28.920786 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:28.920825 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.920871 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:28.920898 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:28.925097 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.3:42749
I20240501 19:57:28.925136 18280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.3:42749 every 8 connection(s)
I20240501 19:57:28.929184 18281 heartbeater.cc:347] Connected to a master server at 127.16.155.62:38023
I20240501 19:57:28.929277 18281 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:28.929510 18281 heartbeater.cc:511] Master 127.16.155.62:38023 requested a full tablet report, sending...
I20240501 19:57:28.930207 18001 ts_manager.cc:194] Registered new tserver with Master: 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:28.930683 18001 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34914
I20240501 19:57:28.931018 17004 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005521506s
I20240501 19:57:28.931455 17004 test_util.cc:268] Using random seed: -445304706
I20240501 19:57:28.938256 18001 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34930:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 19:57:28.939239 18001 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 19:57:28.966893 18170 tablet_service.cc:1467] Processing CreateTablet for tablet 35f0b0466c85499ba02a5ac1d3af8637 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 19:57:28.967232 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f0b0466c85499ba02a5ac1d3af8637. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.967432 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 819cf24be08746ab892f903e3119392b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 19:57:28.967693 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819cf24be08746ab892f903e3119392b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.967968 18236 tablet_service.cc:1467] Processing CreateTablet for tablet 6c666aa80bd648f3b2857a2f19d6b26a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 19:57:28.968255 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c666aa80bd648f3b2857a2f19d6b26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.967252 18094 tablet_service.cc:1467] Processing CreateTablet for tablet 35f0b0466c85499ba02a5ac1d3af8637 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 19:57:28.969698 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 819cf24be08746ab892f903e3119392b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 19:57:28.970460 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f0b0466c85499ba02a5ac1d3af8637. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.970738 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 71582136edac4d888b956930282063b2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 19:57:28.970973 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71582136edac4d888b956930282063b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.971022 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 3d466985b37e4bd58a2920fe6008093d (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 19:57:28.971254 18244 tablet_service.cc:1467] Processing CreateTablet for tablet 819cf24be08746ab892f903e3119392b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 19:57:28.971432 18240 tablet_service.cc:1467] Processing CreateTablet for tablet e9327269d61b47f19172d4c209c710e7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 19:57:28.971706 18085 tablet_service.cc:1467] Processing CreateTablet for tablet 6c666aa80bd648f3b2857a2f19d6b26a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 19:57:28.971782 18238 tablet_service.cc:1467] Processing CreateTablet for tablet 0a43eb46633f4a25b08b84779c0d64ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 19:57:28.971498 18244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819cf24be08746ab892f903e3119392b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.972101 18086 tablet_service.cc:1467] Processing CreateTablet for tablet 7c343b15b92a4d84a539e3122ed85ef2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 19:57:28.972482 18168 tablet_service.cc:1467] Processing CreateTablet for tablet 4fee40f19ff4468aa38a3d28b189ee56 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 19:57:28.972865 18245 tablet_service.cc:1467] Processing CreateTablet for tablet 35f0b0466c85499ba02a5ac1d3af8637 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 19:57:28.971254 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d466985b37e4bd58a2920fe6008093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.974392 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819cf24be08746ab892f903e3119392b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.974579 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a43eb46633f4a25b08b84779c0d64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.974571 18241 tablet_service.cc:1467] Processing CreateTablet for tablet 8e999d46100b4fd39bbee770470a6967 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 19:57:28.974726 18243 tablet_service.cc:1467] Processing CreateTablet for tablet 4fee40f19ff4468aa38a3d28b189ee56 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 19:57:28.974946 18237 tablet_service.cc:1467] Processing CreateTablet for tablet 7c343b15b92a4d84a539e3122ed85ef2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 19:57:28.975127 18239 tablet_service.cc:1467] Processing CreateTablet for tablet 357676875d3b4ce190161065f07c507f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 19:57:28.975345 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c666aa80bd648f3b2857a2f19d6b26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.975484 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fee40f19ff4468aa38a3d28b189ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.975917 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c343b15b92a4d84a539e3122ed85ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.976138 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 3d466985b37e4bd58a2920fe6008093d (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 19:57:28.976424 18087 tablet_service.cc:1467] Processing CreateTablet for tablet 0a43eb46633f4a25b08b84779c0d64ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 19:57:28.976665 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a43eb46633f4a25b08b84779c0d64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.977977 18094 tablet_service.cc:1467] Processing CreateTablet for tablet 76652359a5e4493c8b8b6af23cf4c834 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 19:57:28.978255 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76652359a5e4493c8b8b6af23cf4c834. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.978572 18236 tablet_service.cc:1467] Processing CreateTablet for tablet b73b6624ee0145fdaa68b19890c88211 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 19:57:28.978724 18087 tablet_service.cc:1467] Processing CreateTablet for tablet ae0b1e22eede490e983dd3fe8e3ae9f5 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 19:57:28.975915 18093 tablet_service.cc:1467] Processing CreateTablet for tablet b73b6624ee0145fdaa68b19890c88211 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 19:57:28.978950 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0b1e22eede490e983dd3fe8e3ae9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.979084 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b6624ee0145fdaa68b19890c88211. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.979161 18167 tablet_service.cc:1467] Processing CreateTablet for tablet 71582136edac4d888b956930282063b2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 19:57:28.979410 18167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71582136edac4d888b956930282063b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.980149 18094 tablet_service.cc:1467] Processing CreateTablet for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 19:57:28.980362 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.980855 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 35e7e35b622f44e08a530601ac203994 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 19:57:28.981081 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35e7e35b622f44e08a530601ac203994. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.981588 18240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9327269d61b47f19172d4c209c710e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.977977 18086 tablet_service.cc:1467] Processing CreateTablet for tablet e462158d407e44278078992c7b4f6a43 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 19:57:28.981928 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e462158d407e44278078992c7b4f6a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.983247 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 2749600d09ea4d459be9f981c5f082db (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 19:57:28.983479 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2749600d09ea4d459be9f981c5f082db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.983556 18164 tablet_service.cc:1467] Processing CreateTablet for tablet 357676875d3b4ce190161065f07c507f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 19:57:28.983793 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357676875d3b4ce190161065f07c507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.983768 18086 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 19:57:28.983979 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.981765 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b6624ee0145fdaa68b19890c88211. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.985927 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e999d46100b4fd39bbee770470a6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.985968 18164 tablet_service.cc:1467] Processing CreateTablet for tablet b73b6624ee0145fdaa68b19890c88211 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 19:57:28.986196 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b6624ee0145fdaa68b19890c88211. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.986210 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 74d386ffed734860bb531b7b950da488 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 19:57:28.986424 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d386ffed734860bb531b7b950da488. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.987776 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f0b0466c85499ba02a5ac1d3af8637. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.987941 18164 tablet_service.cc:1467] Processing CreateTablet for tablet 76652359a5e4493c8b8b6af23cf4c834 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 19:57:28.988188 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76652359a5e4493c8b8b6af23cf4c834. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.988420 18298 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:28.988577 18236 tablet_service.cc:1467] Processing CreateTablet for tablet 76652359a5e4493c8b8b6af23cf4c834 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 19:57:28.988780 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 76652359a5e4493c8b8b6af23cf4c834. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.989439 18298 tablet_bootstrap.cc:654] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:28.989799 18245 tablet_service.cc:1467] Processing CreateTablet for tablet e462158d407e44278078992c7b4f6a43 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 19:57:28.990023 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e462158d407e44278078992c7b4f6a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.990164 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 2c406ab4a99549fabe2bd60919a725a8 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 19:57:28.990387 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c406ab4a99549fabe2bd60919a725a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.990883 18086 tablet_service.cc:1467] Processing CreateTablet for tablet 9c252400bfbc43eda2e4f222ee9a4230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 19:57:28.991689 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c252400bfbc43eda2e4f222ee9a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.991289 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d466985b37e4bd58a2920fe6008093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.990959 18166 tablet_service.cc:1467] Processing CreateTablet for tablet 8e999d46100b4fd39bbee770470a6967 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 19:57:28.981428 18167 tablet_service.cc:1467] Processing CreateTablet for tablet 3d466985b37e4bd58a2920fe6008093d (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 19:57:28.992753 18164 tablet_service.cc:1467] Processing CreateTablet for tablet ae0b1e22eede490e983dd3fe8e3ae9f5 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 19:57:28.992762 18170 tablet_service.cc:1467] Processing CreateTablet for tablet e462158d407e44278078992c7b4f6a43 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 19:57:28.992228 18094 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbeb1209494eaf9b58c3f5452d3549 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 19:57:28.993353 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdbeb1209494eaf9b58c3f5452d3549. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.993525 18241 tablet_service.cc:1467] Processing CreateTablet for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 19:57:28.993633 18089 tablet_service.cc:1467] Processing CreateTablet for tablet e9327269d61b47f19172d4c209c710e7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 19:57:28.993793 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.993961 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 0a43eb46633f4a25b08b84779c0d64ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 19:57:28.994187 18088 tablet_service.cc:1467] Processing CreateTablet for tablet 357676875d3b4ce190161065f07c507f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 19:57:28.994397 18165 tablet_service.cc:1467] Processing CreateTablet for tablet e9327269d61b47f19172d4c209c710e7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 19:57:28.994604 18090 tablet_service.cc:1467] Processing CreateTablet for tablet 8e999d46100b4fd39bbee770470a6967 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 19:57:28.994799 18161 tablet_service.cc:1467] Processing CreateTablet for tablet 6c666aa80bd648f3b2857a2f19d6b26a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 19:57:28.994782 18245 tablet_service.cc:1467] Processing CreateTablet for tablet 2749600d09ea4d459be9f981c5f082db (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 19:57:28.995129 18091 tablet_service.cc:1467] Processing CreateTablet for tablet 71582136edac4d888b956930282063b2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 19:57:28.995290 18092 tablet_service.cc:1467] Processing CreateTablet for tablet 4fee40f19ff4468aa38a3d28b189ee56 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 19:57:28.995031 18162 tablet_service.cc:1467] Processing CreateTablet for tablet 7c343b15b92a4d84a539e3122ed85ef2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 19:57:28.995530 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2749600d09ea4d459be9f981c5f082db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.995633 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9327269d61b47f19172d4c209c710e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.995849 18241 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 19:57:28.996454 18236 tablet_service.cc:1467] Processing CreateTablet for tablet ae0b1e22eede490e983dd3fe8e3ae9f5 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 19:57:28.996596 18240 tablet_service.cc:1467] Processing CreateTablet for tablet 74d386ffed734860bb531b7b950da488 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 19:57:28.996722 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.996836 18240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d386ffed734860bb531b7b950da488. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.996970 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0b1e22eede490e983dd3fe8e3ae9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.997375 18166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e999d46100b4fd39bbee770470a6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.997570 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a43eb46633f4a25b08b84779c0d64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.997624 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c343b15b92a4d84a539e3122ed85ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.998826 18236 tablet_service.cc:1467] Processing CreateTablet for tablet 9c252400bfbc43eda2e4f222ee9a4230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 19:57:28.999039 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c252400bfbc43eda2e4f222ee9a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.999486 18165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9327269d61b47f19172d4c209c710e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:28.999666 18240 tablet_service.cc:1467] Processing CreateTablet for tablet 2c406ab4a99549fabe2bd60919a725a8 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 19:57:28.999683 18163 tablet_service.cc:1467] Processing CreateTablet for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 19:57:28.999914 18240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c406ab4a99549fabe2bd60919a725a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.000030 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5b3b0c7c59d4aa099df0a2f4cf8447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.000872 18236 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbeb1209494eaf9b58c3f5452d3549 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 19:57:29.001109 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdbeb1209494eaf9b58c3f5452d3549. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.001559 18165 tablet_service.cc:1467] Processing CreateTablet for tablet 35e7e35b622f44e08a530601ac203994 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 19:57:29.001814 18165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35e7e35b622f44e08a530601ac203994. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.001904 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 2749600d09ea4d459be9f981c5f082db (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 19:57:29.002142 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2749600d09ea4d459be9f981c5f082db. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.002166 18237 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfee7a6c48e487f84b2dd8c708314cd (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 19:57:29.002382 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfee7a6c48e487f84b2dd8c708314cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.003151 18241 tablet_service.cc:1467] Processing CreateTablet for tablet 24d8d08f9d9140eba6cbb4e19b589e5a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 19:57:29.003355 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d8d08f9d9140eba6cbb4e19b589e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.003562 18165 tablet_service.cc:1467] Processing CreateTablet for tablet 5601fd42b321477ab637142f5d4a196b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 19:57:29.003767 18162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c343b15b92a4d84a539e3122ed85ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.004230 18237 tablet_service.cc:1467] Processing CreateTablet for tablet ac1c6a7daf194214a76880a6b4d1edc9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 19:57:29.004453 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1c6a7daf194214a76880a6b4d1edc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.004951 18245 tablet_service.cc:1467] Processing CreateTablet for tablet 3276a6a9232549b5bdc1a82b2ebaefc2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 19:57:29.005234 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3276a6a9232549b5bdc1a82b2ebaefc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.005626 18161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c666aa80bd648f3b2857a2f19d6b26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.006335 18240 tablet_service.cc:1467] Processing CreateTablet for tablet 09a85049bcb54ab3997e07ab7f564c77 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 19:57:29.006600 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae0b1e22eede490e983dd3fe8e3ae9f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.006779 18236 tablet_service.cc:1467] Processing CreateTablet for tablet d20a351a6427444e96bfc1828a990e92 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 19:57:29.006951 18240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a85049bcb54ab3997e07ab7f564c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.005184 18241 tablet_service.cc:1467] Processing CreateTablet for tablet d9f7b594299448a09fa4aefe5af61230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 19:57:28.992229 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfee7a6c48e487f84b2dd8c708314cd (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 19:57:29.007274 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfee7a6c48e487f84b2dd8c708314cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.007551 18167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d466985b37e4bd58a2920fe6008093d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.008069 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e462158d407e44278078992c7b4f6a43. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.008477 18296 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.010090 18239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357676875d3b4ce190161065f07c507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.012698 18296 tablet_bootstrap.cc:654] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.013779 18239 tablet_service.cc:1467] Processing CreateTablet for tablet d193261354994d2db384d9db69a5b463 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 19:57:29.009033 18237 tablet_service.cc:1467] Processing CreateTablet for tablet d9e0f2e994d247ff90b3bf5f2f124e35 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 19:57:29.009543 18245 tablet_service.cc:1467] Processing CreateTablet for tablet fd26327aee2e4181baeab9dd52e5fa02 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 19:57:29.014482 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 19:57:29.014350 18165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5601fd42b321477ab637142f5d4a196b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.015540 18166 tablet_service.cc:1467] Processing CreateTablet for tablet 2cfee7a6c48e487f84b2dd8c708314cd (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 19:57:29.015632 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d7bd95fff5b4435bbb1825d1fb0ede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.015769 18166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfee7a6c48e487f84b2dd8c708314cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.015116 18170 tablet_service.cc:1467] Processing CreateTablet for tablet dfdbeb1209494eaf9b58c3f5452d3549 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 19:57:29.016059 18162 tablet_service.cc:1467] Processing CreateTablet for tablet 74d386ffed734860bb531b7b950da488 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 19:57:29.016269 18162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d386ffed734860bb531b7b950da488. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.017696 18166 tablet_service.cc:1467] Processing CreateTablet for tablet 24d8d08f9d9140eba6cbb4e19b589e5a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 19:57:29.017931 18166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d8d08f9d9140eba6cbb4e19b589e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.018431 18162 tablet_service.cc:1467] Processing CreateTablet for tablet ac1c6a7daf194214a76880a6b4d1edc9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 19:57:29.018668 18162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1c6a7daf194214a76880a6b4d1edc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.019093 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 3276a6a9232549b5bdc1a82b2ebaefc2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 19:57:29.019326 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3276a6a9232549b5bdc1a82b2ebaefc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.019763 18166 tablet_service.cc:1467] Processing CreateTablet for tablet d9f7b594299448a09fa4aefe5af61230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 19:57:29.019984 18166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9f7b594299448a09fa4aefe5af61230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.020476 18162 tablet_service.cc:1467] Processing CreateTablet for tablet 09a85049bcb54ab3997e07ab7f564c77 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 19:57:29.020714 18162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a85049bcb54ab3997e07ab7f564c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.021217 18169 tablet_service.cc:1467] Processing CreateTablet for tablet d20a351a6427444e96bfc1828a990e92 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 19:57:29.021433 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d20a351a6427444e96bfc1828a990e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.021572 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fee40f19ff4468aa38a3d28b189ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.023255 18239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d193261354994d2db384d9db69a5b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.023188 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 5601fd42b321477ab637142f5d4a196b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 19:57:29.023381 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9f7b594299448a09fa4aefe5af61230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.023537 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfdbeb1209494eaf9b58c3f5452d3549. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.023752 18244 tablet_service.cc:1467] Processing CreateTablet for tablet 35e7e35b622f44e08a530601ac203994 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 19:57:29.023983 18244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35e7e35b622f44e08a530601ac203994. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.024760 18238 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba4c26eae1f4731982f3bb0485eace9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 19:57:29.024978 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba4c26eae1f4731982f3bb0485eace9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.025223 18241 tablet_service.cc:1467] Processing CreateTablet for tablet f2019ede82614cedb5655ccbaf31cb8b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 19:57:29.025436 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2019ede82614cedb5655ccbaf31cb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.026016 18244 tablet_service.cc:1467] Processing CreateTablet for tablet 1712a8811770442ebe9a94ac36f23362 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 19:57:29.026284 18244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1712a8811770442ebe9a94ac36f23362. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.027251 18165 tablet_service.cc:1467] Processing CreateTablet for tablet fd26327aee2e4181baeab9dd52e5fa02 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 19:57:29.027465 18165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd26327aee2e4181baeab9dd52e5fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.028045 18243 tablet_service.cc:1467] Processing CreateTablet for tablet 3e38554d7de3475f9352b913e4f2a87c (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 19:57:29.028077 18244 tablet_service.cc:1467] Processing CreateTablet for tablet 590f797b1246400988d4177b27acd261 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 19:57:29.028263 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e38554d7de3475f9352b913e4f2a87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.028465 18163 tablet_service.cc:1467] Processing CreateTablet for tablet d193261354994d2db384d9db69a5b463 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 19:57:29.028687 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d193261354994d2db384d9db69a5b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.029572 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5601fd42b321477ab637142f5d4a196b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.029991 18167 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba4c26eae1f4731982f3bb0485eace9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 19:57:29.030118 18241 tablet_service.cc:1467] Processing CreateTablet for tablet 5e3f8dc551384672a732e4f400999213 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 19:57:29.030202 18167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba4c26eae1f4731982f3bb0485eace9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.030221 18243 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1b770b027404a81b4bc7a4080e3ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 19:57:29.030359 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e3f8dc551384672a732e4f400999213. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.031181 18168 tablet_service.cc:1467] Processing CreateTablet for tablet 2c406ab4a99549fabe2bd60919a725a8 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 19:57:29.031452 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c406ab4a99549fabe2bd60919a725a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.031551 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 4add94039d71435ea2a6616ac3746de6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 19:57:29.031819 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4add94039d71435ea2a6616ac3746de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.032406 18167 tablet_service.cc:1467] Processing CreateTablet for tablet f2019ede82614cedb5655ccbaf31cb8b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 19:57:29.032644 18167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2019ede82614cedb5655ccbaf31cb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.033238 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 1712a8811770442ebe9a94ac36f23362 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 19:57:29.027472 18238 tablet_service.cc:1467] Processing CreateTablet for tablet d00f74f62f4d43888bfd5ac0dbdacd8a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 19:57:29.033830 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9ae0611714476599196cbc902d5f66 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 19:57:29.033946 18161 tablet_service.cc:1467] Processing CreateTablet for tablet 9c252400bfbc43eda2e4f222ee9a4230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 19:57:29.034003 18239 tablet_service.cc:1467] Processing CreateTablet for tablet 0329a5653d944689bd539e54b2531c32 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 19:57:29.033632 18168 tablet_service.cc:1467] Processing CreateTablet for tablet d00f74f62f4d43888bfd5ac0dbdacd8a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 19:57:29.023188 18169 tablet_service.cc:1467] Processing CreateTablet for tablet d9e0f2e994d247ff90b3bf5f2f124e35 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 19:57:29.033744 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00f74f62f4d43888bfd5ac0dbdacd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.034305 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357676875d3b4ce190161065f07c507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.034401 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1b770b027404a81b4bc7a4080e3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.034663 18090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e999d46100b4fd39bbee770470a6967. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.034716 18244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590f797b1246400988d4177b27acd261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.034986 18091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71582136edac4d888b956930282063b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.035341 18092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fee40f19ff4468aa38a3d28b189ee56. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.035567 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9e0f2e994d247ff90b3bf5f2f124e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.035967 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9ae0611714476599196cbc902d5f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.036458 18238 tablet_service.cc:1467] Processing CreateTablet for tablet 65eb080a29294efeb39e2c29a008181f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 19:57:29.036689 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65eb080a29294efeb39e2c29a008181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.033620 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1712a8811770442ebe9a94ac36f23362. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.039057 18297 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.039314 18089 tablet_service.cc:1467] Processing CreateTablet for tablet 24d8d08f9d9140eba6cbb4e19b589e5a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 19:57:29.039535 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d8d08f9d9140eba6cbb4e19b589e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.040053 18297 tablet_bootstrap.cc:654] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.040695 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d20a351a6427444e96bfc1828a990e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.040712 18091 tablet_service.cc:1467] Processing CreateTablet for tablet ac1c6a7daf194214a76880a6b4d1edc9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 19:57:29.040972 18091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac1c6a7daf194214a76880a6b4d1edc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.041455 18089 tablet_service.cc:1467] Processing CreateTablet for tablet 3276a6a9232549b5bdc1a82b2ebaefc2 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 19:57:29.042270 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3276a6a9232549b5bdc1a82b2ebaefc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.043038 18088 tablet_service.cc:1467] Processing CreateTablet for tablet d9f7b594299448a09fa4aefe5af61230 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 19:57:29.043282 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9f7b594299448a09fa4aefe5af61230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.043462 18245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd26327aee2e4181baeab9dd52e5fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.043751 18237 tablet_service.cc:1467] Processing CreateTablet for tablet c426ee194254489c8be8b188642f20c4 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 19:57:29.043967 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426ee194254489c8be8b188642f20c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.044059 18089 tablet_service.cc:1467] Processing CreateTablet for tablet 09a85049bcb54ab3997e07ab7f564c77 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 19:57:29.044276 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 09a85049bcb54ab3997e07ab7f564c77. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.045185 18088 tablet_service.cc:1467] Processing CreateTablet for tablet d20a351a6427444e96bfc1828a990e92 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 19:57:29.045431 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d20a351a6427444e96bfc1828a990e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.047528 18087 tablet_service.cc:1467] Processing CreateTablet for tablet d193261354994d2db384d9db69a5b463 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 19:57:29.047782 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d193261354994d2db384d9db69a5b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.047830 18237 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc61f5a2be4433385c75108851784d7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 19:57:29.048065 18237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc61f5a2be4433385c75108851784d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.047922 18236 tablet_service.cc:1467] Processing CreateTablet for tablet 818d68581b324da38ffec03581cb3c12 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 19:57:29.047996 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 5601fd42b321477ab637142f5d4a196b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 19:57:29.048542 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5601fd42b321477ab637142f5d4a196b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.048583 18236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818d68581b324da38ffec03581cb3c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.045873 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00f74f62f4d43888bfd5ac0dbdacd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.050096 18241 tablet_service.cc:1467] Processing CreateTablet for tablet e7c63719b49c4ceda03621bd77c91ff6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 19:57:29.050331 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c63719b49c4ceda03621bd77c91ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.050413 18085 tablet_service.cc:1467] Processing CreateTablet for tablet f2019ede82614cedb5655ccbaf31cb8b (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 19:57:29.050635 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2019ede82614cedb5655ccbaf31cb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.051175 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9e0f2e994d247ff90b3bf5f2f124e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.051524 18168 tablet_service.cc:1467] Processing CreateTablet for tablet 5e3f8dc551384672a732e4f400999213 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 19:57:29.051949 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e3f8dc551384672a732e4f400999213. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.052554 18085 tablet_service.cc:1467] Processing CreateTablet for tablet 1712a8811770442ebe9a94ac36f23362 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 19:57:29.052646 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0cdf9414db4baa9427c85c30d79e0a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 19:57:29.052759 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1712a8811770442ebe9a94ac36f23362. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.052874 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0cdf9414db4baa9427c85c30d79e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.053305 18169 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1b770b027404a81b4bc7a4080e3ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 19:57:29.053535 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1b770b027404a81b4bc7a4080e3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.053584 18239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0329a5653d944689bd539e54b2531c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.054371 18092 tablet_service.cc:1467] Processing CreateTablet for tablet d00f74f62f4d43888bfd5ac0dbdacd8a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 19:57:29.054600 18092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d00f74f62f4d43888bfd5ac0dbdacd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.054708 18088 tablet_service.cc:1467] Processing CreateTablet for tablet 1ba4c26eae1f4731982f3bb0485eace9 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 19:57:29.054911 18244 tablet_service.cc:1467] Processing CreateTablet for tablet ffbfd18ef4fc4fe393e9915ad65c69cf (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 19:57:29.055168 18244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbfd18ef4fc4fe393e9915ad65c69cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.055641 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 4add94039d71435ea2a6616ac3746de6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 19:57:29.055776 18168 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9ae0611714476599196cbc902d5f66 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 19:57:29.055860 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4add94039d71435ea2a6616ac3746de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.055989 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9ae0611714476599196cbc902d5f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.056555 18092 tablet_service.cc:1467] Processing CreateTablet for tablet 3e38554d7de3475f9352b913e4f2a87c (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 19:57:29.057276 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 0329a5653d944689bd539e54b2531c32 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 19:57:29.057545 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0329a5653d944689bd539e54b2531c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.058038 18090 tablet_service.cc:1467] Processing CreateTablet for tablet 590f797b1246400988d4177b27acd261 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 19:57:29.058431 18168 tablet_service.cc:1467] Processing CreateTablet for tablet 65eb080a29294efeb39e2c29a008181f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 19:57:29.058677 18168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65eb080a29294efeb39e2c29a008181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.054913 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ba4c26eae1f4731982f3bb0485eace9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.059190 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 478eb3c7c83d4d9a9f329163435d8389 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 19:57:29.059398 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478eb3c7c83d4d9a9f329163435d8389. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.060117 18085 tablet_service.cc:1467] Processing CreateTablet for tablet 5e3f8dc551384672a732e4f400999213 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 19:57:29.060362 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e3f8dc551384672a732e4f400999213. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.060391 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 818d68581b324da38ffec03581cb3c12 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 19:57:29.060595 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818d68581b324da38ffec03581cb3c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.061169 18169 tablet_service.cc:1467] Processing CreateTablet for tablet c426ee194254489c8be8b188642f20c4 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 19:57:29.061237 18088 tablet_service.cc:1467] Processing CreateTablet for tablet dfe1b770b027404a81b4bc7a4080e3ae (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 19:57:29.061383 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426ee194254489c8be8b188642f20c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.061717 18170 tablet_service.cc:1467] Processing CreateTablet for tablet 88369b2534e44de0a090bd8eaa461755 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 19:57:29.061936 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88369b2534e44de0a090bd8eaa461755. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.061980 18086 tablet_service.cc:1467] Processing CreateTablet for tablet 4add94039d71435ea2a6616ac3746de6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 19:57:29.062513 18161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c252400bfbc43eda2e4f222ee9a4230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.062640 18093 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9ae0611714476599196cbc902d5f66 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 19:57:29.063023 18163 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc61f5a2be4433385c75108851784d7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 19:57:29.063247 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc61f5a2be4433385c75108851784d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.063791 18170 tablet_service.cc:1467] Processing CreateTablet for tablet e7c63719b49c4ceda03621bd77c91ff6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 19:57:29.064061 18170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c63719b49c4ceda03621bd77c91ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.064711 18161 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae71a6ccffe4c1f908ccae0efba2841 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 19:57:29.064954 18161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae71a6ccffe4c1f908ccae0efba2841. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.065059 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0cdf9414db4baa9427c85c30d79e0a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 19:57:29.065287 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0cdf9414db4baa9427c85c30d79e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.047508 18091 tablet_service.cc:1467] Processing CreateTablet for tablet fd26327aee2e4181baeab9dd52e5fa02 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 19:57:29.066154 18087 tablet_service.cc:1467] Processing CreateTablet for tablet 0329a5653d944689bd539e54b2531c32 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 19:57:29.066345 18163 tablet_service.cc:1467] Processing CreateTablet for tablet ffbfd18ef4fc4fe393e9915ad65c69cf (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 19:57:29.066566 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbfd18ef4fc4fe393e9915ad65c69cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.066826 18240 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae71a6ccffe4c1f908ccae0efba2841 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 19:57:29.067116 18169 tablet_service.cc:1467] Processing CreateTablet for tablet bc7844cb8be7435ebb038b6340f6b27a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 19:57:29.067341 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7844cb8be7435ebb038b6340f6b27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.067569 18085 tablet_service.cc:1467] Processing CreateTablet for tablet 65eb080a29294efeb39e2c29a008181f (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 19:57:29.046255 18166 tablet_service.cc:1467] Processing CreateTablet for tablet 590f797b1246400988d4177b27acd261 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 19:57:29.046792 18243 tablet_service.cc:1467] Processing CreateTablet for tablet 88369b2534e44de0a090bd8eaa461755 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 19:57:29.069948 18169 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5c99ef38464bb4997b2aef8807b765 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 19:57:29.046838 18089 tablet_service.cc:1467] Processing CreateTablet for tablet d9e0f2e994d247ff90b3bf5f2f124e35 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 19:57:29.070348 18169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5c99ef38464bb4997b2aef8807b765. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.067303 18240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae71a6ccffe4c1f908ccae0efba2841. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.045981 18164 tablet_service.cc:1467] Processing CreateTablet for tablet 3e38554d7de3475f9352b913e4f2a87c (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 19:57:29.070950 18094 tablet_service.cc:1467] Processing CreateTablet for tablet 478eb3c7c83d4d9a9f329163435d8389 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 19:57:29.071208 18164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e38554d7de3475f9352b913e4f2a87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.071604 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88369b2534e44de0a090bd8eaa461755. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.069913 18163 tablet_service.cc:1467] Processing CreateTablet for tablet b98df59ebac64a7b8d40f0b227cdf42a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 19:57:29.038733 18238 tablet_service.cc:1467] Processing CreateTablet for tablet 478eb3c7c83d4d9a9f329163435d8389 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 19:57:29.071847 18163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98df59ebac64a7b8d40f0b227cdf42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.071911 18238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478eb3c7c83d4d9a9f329163435d8389. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.061460 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dfe1b770b027404a81b4bc7a4080e3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.073295 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9e0f2e994d247ff90b3bf5f2f124e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.073454 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4add94039d71435ea2a6616ac3746de6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.070050 18162 tablet_service.cc:1467] Processing CreateTablet for tablet 2b73caad778849b0b6c7cb625d4f0f24 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 19:57:29.073742 18162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b73caad778849b0b6c7cb625d4f0f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.075004 18088 tablet_service.cc:1467] Processing CreateTablet for tablet 818d68581b324da38ffec03581cb3c12 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 19:57:29.075263 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818d68581b324da38ffec03581cb3c12. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.075369 18089 tablet_service.cc:1467] Processing CreateTablet for tablet c426ee194254489c8be8b188642f20c4 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 19:57:29.075618 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426ee194254489c8be8b188642f20c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.076172 18086 tablet_service.cc:1467] Processing CreateTablet for tablet 88369b2534e44de0a090bd8eaa461755 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 19:57:29.076472 18086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88369b2534e44de0a090bd8eaa461755. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.077071 18088 tablet_service.cc:1467] Processing CreateTablet for tablet 6dc61f5a2be4433385c75108851784d7 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 19:57:29.077286 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6dc61f5a2be4433385c75108851784d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.077709 18090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590f797b1246400988d4177b27acd261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.077850 18085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65eb080a29294efeb39e2c29a008181f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.082623 18092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e38554d7de3475f9352b913e4f2a87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.083931 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0329a5653d944689bd539e54b2531c32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.084110 18092 tablet_service.cc:1467] Processing CreateTablet for tablet 1c0cdf9414db4baa9427c85c30d79e0a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 19:57:29.084134 18090 tablet_service.cc:1467] Processing CreateTablet for tablet ffbfd18ef4fc4fe393e9915ad65c69cf (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 19:57:29.084292 18092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c0cdf9414db4baa9427c85c30d79e0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.084733 18090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ffbfd18ef4fc4fe393e9915ad65c69cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.085690 18091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd26327aee2e4181baeab9dd52e5fa02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.085913 18092 tablet_service.cc:1467] Processing CreateTablet for tablet b98df59ebac64a7b8d40f0b227cdf42a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 19:57:29.086131 18093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9ae0611714476599196cbc902d5f66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.077975 18089 tablet_service.cc:1467] Processing CreateTablet for tablet e7c63719b49c4ceda03621bd77c91ff6 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 19:57:29.079013 18243 tablet_service.cc:1467] Processing CreateTablet for tablet bc7844cb8be7435ebb038b6340f6b27a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 19:57:29.086510 18243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7844cb8be7435ebb038b6340f6b27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.086925 18090 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5c99ef38464bb4997b2aef8807b765 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 19:57:29.087142 18090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5c99ef38464bb4997b2aef8807b765. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.087654 18091 tablet_service.cc:1467] Processing CreateTablet for tablet 2b73caad778849b0b6c7cb625d4f0f24 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 19:57:29.087878 18091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b73caad778849b0b6c7cb625d4f0f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.079489 18296 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.088326 18296 ts_tablet_manager.cc:1367] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.113s user 0.003s sys 0.000s
I20240501 19:57:29.088965 18296 raft_consensus.cc:348] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.089074 18296 raft_consensus.cc:374] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.089107 18296 raft_consensus.cc:729] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.089113 18166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 590f797b1246400988d4177b27acd261. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.079031 18088 tablet_service.cc:1467] Processing CreateTablet for tablet 9ae71a6ccffe4c1f908ccae0efba2841 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 19:57:29.089260 18296 consensus_queue.cc:260] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.089454 18088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae71a6ccffe4c1f908ccae0efba2841. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.089694 18296 ts_tablet_manager.cc:1398] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.089867 18296 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.090785 18296 tablet_bootstrap.cc:654] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.091126 18206 heartbeater.cc:503] Master 127.16.155.62:38023 was elected leader, sending a full tablet report...
I20240501 19:57:29.079936 18241 tablet_service.cc:1467] Processing CreateTablet for tablet b98df59ebac64a7b8d40f0b227cdf42a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 19:57:29.080147 18298 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.091455 18298 ts_tablet_manager.cc:1367] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.000s
I20240501 19:57:29.091499 18241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98df59ebac64a7b8d40f0b227cdf42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.091897 18298 raft_consensus.cc:348] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.091990 18298 raft_consensus.cc:374] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.092022 18298 raft_consensus.cc:729] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.092142 18298 consensus_queue.cc:260] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.092458 18298 ts_tablet_manager.cc:1398] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.092528 18281 heartbeater.cc:503] Master 127.16.155.62:38023 was elected leader, sending a full tablet report...
I20240501 19:57:29.092612 18298 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.080268 18297 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.092726 18297 ts_tablet_manager.cc:1367] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20240501 19:57:29.093170 18297 raft_consensus.cc:348] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.093261 18297 raft_consensus.cc:374] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.093293 18297 raft_consensus.cc:729] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.093394 18297 consensus_queue.cc:260] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.093576 18298 tablet_bootstrap.cc:654] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.080453 18239 tablet_service.cc:1467] Processing CreateTablet for tablet 2b5c99ef38464bb4997b2aef8807b765 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 19:57:29.093585 18296 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.093730 18296 ts_tablet_manager.cc:1367] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 19:57:29.093780 18239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b5c99ef38464bb4997b2aef8807b765. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.093881 18089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7c63719b49c4ceda03621bd77c91ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.081169 18242 tablet_service.cc:1467] Processing CreateTablet for tablet 2b73caad778849b0b6c7cb625d4f0f24 (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 19:57:29.094307 18242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b73caad778849b0b6c7cb625d4f0f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.094678 18297 ts_tablet_manager.cc:1398] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.094861 18297 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.095461 18092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b98df59ebac64a7b8d40f0b227cdf42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.095830 18297 tablet_bootstrap.cc:654] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.096226 18130 heartbeater.cc:503] Master 127.16.155.62:38023 was elected leader, sending a full tablet report...
I20240501 19:57:29.085925 18087 tablet_service.cc:1467] Processing CreateTablet for tablet bc7844cb8be7435ebb038b6340f6b27a (DEFAULT_TABLE table=test-workload [id=685bf390c4b34454876285d28e7825ff]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 19:57:29.097039 18087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc7844cb8be7435ebb038b6340f6b27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.097595 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 478eb3c7c83d4d9a9f329163435d8389. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:29.098984 18296 raft_consensus.cc:348] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.099076 18296 raft_consensus.cc:374] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.099110 18296 raft_consensus.cc:729] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.099233 18296 consensus_queue.cc:260] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.099754 18296 ts_tablet_manager.cc:1398] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20240501 19:57:29.099838 18297 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.099913 18297 ts_tablet_manager.cc:1367] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.100343 18297 raft_consensus.cc:348] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.100428 18297 raft_consensus.cc:374] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.100456 18297 raft_consensus.cc:729] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.100637 18297 consensus_queue.cc:260] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.100875 18297 ts_tablet_manager.cc:1398] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.101032 18297 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.099911 18296 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.101977 18297 tablet_bootstrap.cc:654] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.102483 18296 tablet_bootstrap.cc:654] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.103709 18297 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.103765 18298 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.103803 18297 ts_tablet_manager.cc:1367] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.103834 18298 ts_tablet_manager.cc:1367] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20240501 19:57:29.104243 18297 raft_consensus.cc:348] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.104351 18297 raft_consensus.cc:374] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.104315 18298 raft_consensus.cc:348] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.104396 18297 raft_consensus.cc:729] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.104458 18298 raft_consensus.cc:374] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.104496 18298 raft_consensus.cc:729] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.104655 18296 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.104604 18298 consensus_queue.cc:260] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.104725 18296 ts_tablet_manager.cc:1367] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240501 19:57:29.104892 18298 ts_tablet_manager.cc:1398] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.105036 18298 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.105132 18296 raft_consensus.cc:348] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.105211 18296 raft_consensus.cc:374] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.105238 18296 raft_consensus.cc:729] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.105336 18296 consensus_queue.cc:260] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.105621 18296 ts_tablet_manager.cc:1398] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.105774 18296 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.105955 18298 tablet_bootstrap.cc:654] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.104590 18297 consensus_queue.cc:260] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.106731 18296 tablet_bootstrap.cc:654] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.106778 18297 ts_tablet_manager.cc:1398] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.106932 18297 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.107896 18298 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.107977 18298 ts_tablet_manager.cc:1367] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.108098 18296 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.108157 18296 ts_tablet_manager.cc:1367] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.108378 18298 raft_consensus.cc:348] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.108460 18298 raft_consensus.cc:374] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.108510 18298 raft_consensus.cc:729] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.108500 18296 raft_consensus.cc:348] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.108610 18296 raft_consensus.cc:374] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.108641 18296 raft_consensus.cc:729] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.108652 18298 consensus_queue.cc:260] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.108741 18296 consensus_queue.cc:260] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.108961 18296 ts_tablet_manager.cc:1398] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.108969 18298 ts_tablet_manager.cc:1398] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.109149 18296 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.109136 18298 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.109462 18297 tablet_bootstrap.cc:654] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.110177 18298 tablet_bootstrap.cc:654] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.110173 18296 tablet_bootstrap.cc:654] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.111546 18298 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.111644 18298 ts_tablet_manager.cc:1367] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.112123 18298 raft_consensus.cc:348] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.112241 18298 raft_consensus.cc:374] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.112283 18298 raft_consensus.cc:729] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.112402 18298 consensus_queue.cc:260] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.112721 18298 ts_tablet_manager.cc:1398] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.112926 18298 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.113401 18297 tablet_bootstrap.cc:492] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.113596 18297 ts_tablet_manager.cc:1367] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240501 19:57:29.112406 18296 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.113934 18296 ts_tablet_manager.cc:1367] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.114077 18298 tablet_bootstrap.cc:654] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.114060 18297 raft_consensus.cc:348] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.114193 18297 raft_consensus.cc:374] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.114238 18297 raft_consensus.cc:729] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.114359 18297 consensus_queue.cc:260] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.114373 18296 raft_consensus.cc:348] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.114492 18296 raft_consensus.cc:374] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.114537 18296 raft_consensus.cc:729] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.114647 18297 ts_tablet_manager.cc:1398] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.114661 18296 consensus_queue.cc:260] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.114828 18297 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.114984 18296 ts_tablet_manager.cc:1398] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.115123 18298 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.115150 18296 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.115202 18298 ts_tablet_manager.cc:1367] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:29.115590 18298 raft_consensus.cc:348] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.115701 18298 raft_consensus.cc:374] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.115738 18298 raft_consensus.cc:729] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.115783 18297 tablet_bootstrap.cc:654] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.115847 18298 consensus_queue.cc:260] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.116012 18296 tablet_bootstrap.cc:654] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.116140 18298 ts_tablet_manager.cc:1398] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.116314 18298 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.117014 18296 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.117161 18296 ts_tablet_manager.cc:1367] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.117333 18298 tablet_bootstrap.cc:654] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.117663 18296 raft_consensus.cc:348] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.117792 18296 raft_consensus.cc:374] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.117837 18296 raft_consensus.cc:729] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.118002 18296 consensus_queue.cc:260] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.118271 18296 ts_tablet_manager.cc:1398] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.118387 18296 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.118597 18298 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.118690 18298 ts_tablet_manager.cc:1367] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:29.119012 18296 tablet_bootstrap.cc:654] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.119119 18298 raft_consensus.cc:348] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.119235 18298 raft_consensus.cc:374] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.119274 18298 raft_consensus.cc:729] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.119405 18298 consensus_queue.cc:260] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.119742 18298 ts_tablet_manager.cc:1398] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.119925 18297 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.120018 18297 ts_tablet_manager.cc:1367] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240501 19:57:29.119935 18298 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.120405 18297 raft_consensus.cc:348] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.120493 18297 raft_consensus.cc:374] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.120525 18297 raft_consensus.cc:729] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.120620 18297 consensus_queue.cc:260] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.120868 18297 ts_tablet_manager.cc:1398] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.121042 18297 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.121229 18298 tablet_bootstrap.cc:654] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.121968 18297 tablet_bootstrap.cc:654] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.122773 18296 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.122907 18296 ts_tablet_manager.cc:1367] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.122962 18297 tablet_bootstrap.cc:492] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.123059 18297 ts_tablet_manager.cc:1367] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.123538 18297 raft_consensus.cc:348] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.123692 18297 raft_consensus.cc:374] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.123728 18297 raft_consensus.cc:729] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.123853 18298 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.123852 18297 consensus_queue.cc:260] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.124053 18298 ts_tablet_manager.cc:1367] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.124178 18297 ts_tablet_manager.cc:1398] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.124387 18297 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.124830 18298 raft_consensus.cc:348] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.124938 18298 raft_consensus.cc:374] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.124967 18298 raft_consensus.cc:729] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.125082 18298 consensus_queue.cc:260] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.124060 18296 raft_consensus.cc:348] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.125427 18298 ts_tablet_manager.cc:1398] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.125458 18296 raft_consensus.cc:374] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.125516 18296 raft_consensus.cc:729] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.125427 18297 tablet_bootstrap.cc:654] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.126209 18296 consensus_queue.cc:260] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.126518 18296 ts_tablet_manager.cc:1398] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.126682 18296 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.127609 18296 tablet_bootstrap.cc:654] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.127748 18304 raft_consensus.cc:482] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.127862 18304 raft_consensus.cc:504] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.128356 18304 leader_election.cc:288] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.128664 18296 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.128743 18296 ts_tablet_manager.cc:1367] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.127637 18298 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.129120 18296 raft_consensus.cc:348] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.129220 18296 raft_consensus.cc:374] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.129254 18296 raft_consensus.cc:729] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.129355 18296 consensus_queue.cc:260] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.129637 18296 ts_tablet_manager.cc:1398] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.129675 18298 tablet_bootstrap.cc:654] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.129803 18296 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.130702 18297 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.130811 18297 ts_tablet_manager.cc:1367] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20240501 19:57:29.131210 18296 tablet_bootstrap.cc:654] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.131228 18297 raft_consensus.cc:348] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.131315 18297 raft_consensus.cc:374] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.131395 18297 raft_consensus.cc:729] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.131521 18297 consensus_queue.cc:260] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.131800 18297 ts_tablet_manager.cc:1398] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:29.131968 18297 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.132550 18296 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.132647 18296 ts_tablet_manager.cc:1367] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.132831 18297 tablet_bootstrap.cc:654] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.132923 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f0b0466c85499ba02a5ac1d3af8637" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.133074 18104 raft_consensus.cc:2454] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.133111 18296 raft_consensus.cc:348] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.133183 18296 raft_consensus.cc:374] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.133217 18296 raft_consensus.cc:729] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.133329 18296 consensus_queue.cc:260] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.133363 18220 leader_election.cc:302] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.133535 18304 raft_consensus.cc:2781] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.133584 18304 raft_consensus.cc:482] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.133621 18304 raft_consensus.cc:3037] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.133635 18296 ts_tablet_manager.cc:1398] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.133795 18296 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.133806 18298 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.133913 18302 raft_consensus.cc:482] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.133996 18302 raft_consensus.cc:504] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.134347 18302 leader_election.cc:288] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.134635 18304 raft_consensus.cc:504] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.134711 18296 tablet_bootstrap.cc:654] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.133916 18298 ts_tablet_manager.cc:1367] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.134960 18304 leader_election.cc:288] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
W20240501 19:57:29.135288 18131 tablet.cc:2369] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 19:57:29.135536 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f0b0466c85499ba02a5ac1d3af8637" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.135624 18104 raft_consensus.cc:3037] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.136445 18104 raft_consensus.cc:2454] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.135246 18298 raft_consensus.cc:348] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.136548 18298 raft_consensus.cc:374] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.136605 18298 raft_consensus.cc:729] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.136715 18298 consensus_queue.cc:260] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.136826 18220 leader_election.cc:302] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.136953 18298 ts_tablet_manager.cc:1398] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 19:57:29.137120 18298 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.137121 18304 raft_consensus.cc:2781] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.137537 18304 raft_consensus.cc:686] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.137662 18304 consensus_queue.cc:237] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.138056 18298 tablet_bootstrap.cc:654] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.138360 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f0b0466c85499ba02a5ac1d3af8637" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.138489 18180 raft_consensus.cc:2454] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.138723 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f0b0466c85499ba02a5ac1d3af8637" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.138820 18179 raft_consensus.cc:3037] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.139768 18179 raft_consensus.cc:2454] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.140818 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
W20240501 19:57:29.141184 18145 leader_election.cc:341] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.141412 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.141196 18000 catalog_manager.cc:5484] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
W20240501 19:57:29.141790 18146 leader_election.cc:341] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.141860 18146 leader_election.cc:302] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.142305 18297 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.142421 18297 ts_tablet_manager.cc:1367] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20240501 19:57:29.142609 18328 raft_consensus.cc:2726] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.143167 18297 raft_consensus.cc:348] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.143280 18297 raft_consensus.cc:374] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.143323 18297 raft_consensus.cc:729] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.143435 18297 consensus_queue.cc:260] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.143970 18297 ts_tablet_manager.cc:1398] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:29.144181 18297 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.144924 18297 tablet_bootstrap.cc:654] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.145728 18298 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.145817 18298 ts_tablet_manager.cc:1367] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20240501 19:57:29.146016 18297 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.146104 18297 ts_tablet_manager.cc:1367] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:57:29.146241 18298 raft_consensus.cc:348] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.146353 18298 raft_consensus.cc:374] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.146392 18298 raft_consensus.cc:729] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.146512 18298 consensus_queue.cc:260] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.146667 18297 raft_consensus.cc:348] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.146759 18297 raft_consensus.cc:374] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.146773 18298 ts_tablet_manager.cc:1398] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.146793 18297 raft_consensus.cc:729] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.146916 18297 consensus_queue.cc:260] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.147025 18298 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.147316 18296 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.147401 18296 ts_tablet_manager.cc:1367] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240501 19:57:29.147495 18297 ts_tablet_manager.cc:1398] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:29.147655 18297 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.147789 18296 raft_consensus.cc:348] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.147913 18296 raft_consensus.cc:374] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.147962 18296 raft_consensus.cc:729] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.148073 18296 consensus_queue.cc:260] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.148305 18296 ts_tablet_manager.cc:1398] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.148458 18296 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.148495 18297 tablet_bootstrap.cc:654] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.148937 18328 raft_consensus.cc:482] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.149042 18328 raft_consensus.cc:504] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.149343 18296 tablet_bootstrap.cc:654] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.149859 18297 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.149950 18297 ts_tablet_manager.cc:1367] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:57:29.149530 18328 leader_election.cc:288] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.150276 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.150408 18297 raft_consensus.cc:348] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.150513 18297 raft_consensus.cc:374] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.150553 18297 raft_consensus.cc:729] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
W20240501 19:57:29.150571 18146 leader_election.cc:341] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.150601 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.150686 18104 raft_consensus.cc:2454] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.150672 18297 consensus_queue.cc:260] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.150944 18297 ts_tablet_manager.cc:1398] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:29.151013 18145 leader_election.cc:302] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.151129 18297 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.147922 18298 tablet_bootstrap.cc:654] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.152040 18328 raft_consensus.cc:2781] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.152102 18328 raft_consensus.cc:482] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.152144 18328 raft_consensus.cc:3037] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.152235 18297 tablet_bootstrap.cc:654] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.153064 18328 raft_consensus.cc:504] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.153635 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.153688 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.153761 18104 raft_consensus.cc:3037] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
W20240501 19:57:29.154017 18146 leader_election.cc:341] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.153647 18297 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.154273 18296 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.154309 18297 ts_tablet_manager.cc:1367] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:57:29.154359 18296 ts_tablet_manager.cc:1367] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.154628 18104 raft_consensus.cc:2454] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.154671 18297 raft_consensus.cc:348] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.154769 18328 leader_election.cc:288] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.154775 18297 raft_consensus.cc:374] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.154846 18297 raft_consensus.cc:729] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.154844 18296 raft_consensus.cc:348] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.154935 18296 raft_consensus.cc:374] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.154964 18296 raft_consensus.cc:729] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.155012 18297 consensus_queue.cc:260] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.155105 18296 consensus_queue.cc:260] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.155303 18297 ts_tablet_manager.cc:1398] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.155346 18296 ts_tablet_manager.cc:1398] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.155500 18296 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.155700 18297 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.156265 18296 tablet_bootstrap.cc:654] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.156615 18297 tablet_bootstrap.cc:654] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.156880 18145 leader_election.cc:302] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.157037 18328 raft_consensus.cc:2781] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.157146 18328 raft_consensus.cc:686] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.157272 18328 consensus_queue.cc:237] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.157925 18296 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.158016 18296 ts_tablet_manager.cc:1367] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.158469 18296 raft_consensus.cc:348] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.158592 18296 raft_consensus.cc:374] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.158648 18296 raft_consensus.cc:729] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.158771 18296 consensus_queue.cc:260] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.159050 18296 ts_tablet_manager.cc:1398] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.159039 18000 catalog_manager.cc:5484] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.159255 18296 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.159606 18298 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.159683 18298 ts_tablet_manager.cc:1367] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20240501 19:57:29.160159 18296 tablet_bootstrap.cc:654] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.160125 18298 raft_consensus.cc:348] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.160248 18298 raft_consensus.cc:374] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.160281 18298 raft_consensus.cc:729] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.160378 18298 consensus_queue.cc:260] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.160643 18298 ts_tablet_manager.cc:1398] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.160810 18298 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.160967 18297 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.161062 18297 ts_tablet_manager.cc:1367] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.161465 18297 raft_consensus.cc:348] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.161619 18297 raft_consensus.cc:374] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.161669 18297 raft_consensus.cc:729] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.161756 18298 tablet_bootstrap.cc:654] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.161796 18297 consensus_queue.cc:260] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.162089 18297 ts_tablet_manager.cc:1398] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.162249 18297 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.163097 18297 tablet_bootstrap.cc:654] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.163690 18298 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.163774 18298 ts_tablet_manager.cc:1367] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.163964 18296 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.164033 18296 ts_tablet_manager.cc:1367] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.164198 18298 raft_consensus.cc:348] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.164284 18298 raft_consensus.cc:374] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.164340 18298 raft_consensus.cc:729] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.164323 18296 raft_consensus.cc:348] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.164465 18296 raft_consensus.cc:374] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.164482 18298 consensus_queue.cc:260] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.164542 18296 raft_consensus.cc:729] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.164744 18296 consensus_queue.cc:260] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.164808 18298 ts_tablet_manager.cc:1398] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.164950 18297 tablet_bootstrap.cc:492] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.165000 18298 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.165038 18297 ts_tablet_manager.cc:1367] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.165318 18328 raft_consensus.cc:482] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.165362 18297 raft_consensus.cc:348] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.165393 18328 raft_consensus.cc:504] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.165498 18297 raft_consensus.cc:374] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.165535 18297 raft_consensus.cc:729] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.165654 18297 consensus_queue.cc:260] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.165983 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.166141 18298 tablet_bootstrap.cc:654] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
W20240501 19:57:29.166374 18145 leader_election.cc:341] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.166432 18297 ts_tablet_manager.cc:1398] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.166582 18297 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.166631 18328 leader_election.cc:288] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.165005 18296 ts_tablet_manager.cc:1398] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.166827 18296 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.166827 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.166956 18255 raft_consensus.cc:2454] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.167177 18298 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.167245 18298 ts_tablet_manager.cc:1367] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.167532 18297 tablet_bootstrap.cc:654] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.167732 18296 tablet_bootstrap.cc:654] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.167704 18298 raft_consensus.cc:348] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.167802 18298 raft_consensus.cc:374] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.167842 18298 raft_consensus.cc:729] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.167210 18146 leader_election.cc:302] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters: a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.168164 18328 raft_consensus.cc:2781] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.168252 18328 raft_consensus.cc:482] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.168311 18328 raft_consensus.cc:3037] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.167954 18298 consensus_queue.cc:260] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.168507 18305 raft_consensus.cc:482] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.168624 18305 raft_consensus.cc:504] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.168715 18298 ts_tablet_manager.cc:1398] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.168805 18331 raft_consensus.cc:482] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.168856 18298 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.168922 18331 raft_consensus.cc:504] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.169061 18305 leader_election.cc:288] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.169299 18331 leader_election.cc:288] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.169900 18298 tablet_bootstrap.cc:654] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.170236 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.170346 18179 raft_consensus.cc:2454] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.170331 18328 raft_consensus.cc:504] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.170382 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.170640 18328 leader_election.cc:288] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
W20240501 19:57:29.171130 18220 leader_election.cc:341] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.171298 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.171321 18218 leader_election.cc:302] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters: a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.171402 18255 raft_consensus.cc:3037] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.171404 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
W20240501 19:57:29.171715 18145 leader_election.cc:341] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.172443 18255 raft_consensus.cc:2454] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.172506 18331 raft_consensus.cc:2781] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.172567 18331 raft_consensus.cc:482] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.172612 18331 raft_consensus.cc:3037] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.173249 18146 leader_election.cc:302] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters: a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.174988 18331 raft_consensus.cc:504] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.175297 18331 leader_election.cc:288] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.175611 18328 raft_consensus.cc:2781] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.175709 18328 raft_consensus.cc:686] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.175789 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.175822 18328 consensus_queue.cc:237] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.175881 18179 raft_consensus.cc:3037] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.176733 18179 raft_consensus.cc:2454] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.176831 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76652359a5e4493c8b8b6af23cf4c834" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.176863 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76652359a5e4493c8b8b6af23cf4c834" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.176973 18218 leader_election.cc:302] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.176932 18255 raft_consensus.cc:2454] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.176962 18180 raft_consensus.cc:2454] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.177317 18070 leader_election.cc:302] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.177652 18305 raft_consensus.cc:2781] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.177668 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.177732 18305 raft_consensus.cc:482] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.177776 18305 raft_consensus.cc:3037] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
W20240501 19:57:29.177935 18220 leader_election.cc:341] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.178279 18304 raft_consensus.cc:2781] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.178494 18304 raft_consensus.cc:686] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.178602 18351 raft_consensus.cc:482] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.178634 18305 raft_consensus.cc:504] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.178678 18351 raft_consensus.cc:504] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.178661 18304 consensus_queue.cc:237] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.178946 18305 leader_election.cc:288] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.179160 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76652359a5e4493c8b8b6af23cf4c834" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.179248 18180 raft_consensus.cc:3037] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.179575 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "76652359a5e4493c8b8b6af23cf4c834" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.179678 18255 raft_consensus.cc:3037] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.180043 18180 raft_consensus.cc:2454] T 76652359a5e4493c8b8b6af23cf4c834 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.180493 18255 raft_consensus.cc:2454] T 76652359a5e4493c8b8b6af23cf4c834 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.180670 18297 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.180758 18297 ts_tablet_manager.cc:1367] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20240501 19:57:29.180826 18000 catalog_manager.cc:5484] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.181252 18297 raft_consensus.cc:348] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.181363 18297 raft_consensus.cc:374] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.181404 18297 raft_consensus.cc:729] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.181555 18297 consensus_queue.cc:260] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.181919 18297 ts_tablet_manager.cc:1398] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.182145 18297 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.182160 18067 leader_election.cc:302] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.183555 18305 raft_consensus.cc:2781] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.183741 18305 raft_consensus.cc:686] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.183800 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.183900 18104 raft_consensus.cc:2454] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.183879 18305 consensus_queue.cc:237] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.183962 18351 leader_election.cc:288] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.184165 18354 raft_consensus.cc:482] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.184285 18354 raft_consensus.cc:504] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.184401 18220 leader_election.cc:302] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.184716 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.184763 18354 leader_election.cc:288] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
W20240501 19:57:29.185150 18218 leader_election.cc:341] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.185281 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819cf24be08746ab892f903e3119392b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.185324 18351 raft_consensus.cc:2781] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.185369 18351 raft_consensus.cc:482] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.185389 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819cf24be08746ab892f903e3119392b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.185403 18351 raft_consensus.cc:3037] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.185557 18255 raft_consensus.cc:2454] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
W20240501 19:57:29.185606 18067 leader_election.cc:341] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.183269 18297 tablet_bootstrap.cc:654] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.186461 18070 leader_election.cc:302] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.185045 17999 catalog_manager.cc:5484] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.186704 18354 raft_consensus.cc:2781] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.186461 18351 raft_consensus.cc:504] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.187132 18297 tablet_bootstrap.cc:492] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.187211 18297 ts_tablet_manager.cc:1367] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.187335 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.187414 18104 raft_consensus.cc:3037] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.187633 18297 raft_consensus.cc:348] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.187707 18297 raft_consensus.cc:374] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.187734 18297 raft_consensus.cc:729] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.187830 18297 consensus_queue.cc:260] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.188083 18297 ts_tablet_manager.cc:1398] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.188225 18104 raft_consensus.cc:2454] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.188522 18220 leader_election.cc:302] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.188678 18331 raft_consensus.cc:2781] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.188712 18328 raft_consensus.cc:482] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.188769 18331 raft_consensus.cc:686] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.188789 18328 raft_consensus.cc:504] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.188922 18298 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.188884 18331 consensus_queue.cc:237] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.189000 18298 ts_tablet_manager.cc:1367] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20240501 19:57:29.189110 18328 leader_election.cc:288] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.188930 18351 leader_election.cc:288] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.186787 18354 raft_consensus.cc:482] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.189391 18354 raft_consensus.cc:3037] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.189663 18298 raft_consensus.cc:348] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.189761 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.188251 18297 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
W20240501 19:57:29.190083 18218 leader_election.cc:341] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.190220 18354 raft_consensus.cc:504] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.190582 18354 leader_election.cc:288] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.190919 18297 tablet_bootstrap.cc:654] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.191581 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819cf24be08746ab892f903e3119392b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.191684 18255 raft_consensus.cc:3037] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.191581 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "819cf24be08746ab892f903e3119392b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.191895 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
W20240501 19:57:29.192189 18146 leader_election.cc:341] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.192256 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.192350 18104 raft_consensus.cc:2454] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.192620 18145 leader_election.cc:302] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.192777 18328 raft_consensus.cc:2781] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20240501 19:57:29.192189 18067 leader_election.cc:341] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.192843 18328 raft_consensus.cc:482] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.192881 18255 raft_consensus.cc:2454] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.189777 18298 raft_consensus.cc:374] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.192904 18328 raft_consensus.cc:3037] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.192986 18298 raft_consensus.cc:729] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.191577 18000 catalog_manager.cc:5484] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.193310 18070 leader_election.cc:302] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.193755 18328 raft_consensus.cc:504] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.193109 18298 consensus_queue.cc:260] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.194063 18328 leader_election.cc:288] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.194180 18298 ts_tablet_manager.cc:1398] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240501 19:57:29.194360 18298 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.194676 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
W20240501 19:57:29.194953 18146 leader_election.cc:341] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.195273 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.195379 18104 raft_consensus.cc:3037] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.195916 17999 catalog_manager.cc:5484] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.196300 18104 raft_consensus.cc:2454] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.196795 18145 leader_election.cc:302] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.197029 18328 raft_consensus.cc:2781] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.197137 18328 raft_consensus.cc:686] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.197288 18328 consensus_queue.cc:237] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.197665 18296 tablet_bootstrap.cc:492] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.197746 18296 ts_tablet_manager.cc:1367] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20240501 19:57:29.195390 18298 tablet_bootstrap.cc:654] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.198177 18296 raft_consensus.cc:348] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.198277 18296 raft_consensus.cc:374] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.198312 18296 raft_consensus.cc:729] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.198431 18296 consensus_queue.cc:260] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.198607 18297 tablet_bootstrap.cc:492] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.198685 18297 ts_tablet_manager.cc:1367] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240501 19:57:29.198732 18296 ts_tablet_manager.cc:1398] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.198894 18296 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.198908 18001 catalog_manager.cc:5484] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.199093 18297 raft_consensus.cc:348] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.199191 18297 raft_consensus.cc:374] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.199231 18297 raft_consensus.cc:729] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.199445 18297 consensus_queue.cc:260] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.199728 18297 ts_tablet_manager.cc:1398] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.199949 18354 raft_consensus.cc:2781] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.200030 18296 tablet_bootstrap.cc:654] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.200035 18354 raft_consensus.cc:686] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.200336 18354 consensus_queue.cc:237] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.200554 18297 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.201493 18297 tablet_bootstrap.cc:654] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.202450 18298 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.202539 18298 ts_tablet_manager.cc:1367] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20240501 19:57:29.202603 18000 catalog_manager.cc:5484] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.202903 18298 raft_consensus.cc:348] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.202976 18298 raft_consensus.cc:374] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.202996 18298 raft_consensus.cc:729] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.203097 18298 consensus_queue.cc:260] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.203364 18298 ts_tablet_manager.cc:1398] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.202450 18297 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.203522 18297 ts_tablet_manager.cc:1367] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.203608 18298 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.203907 18297 raft_consensus.cc:348] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.203987 18297 raft_consensus.cc:374] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.204018 18297 raft_consensus.cc:729] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.204135 18297 consensus_queue.cc:260] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.204385 18297 ts_tablet_manager.cc:1398] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.204469 18298 tablet_bootstrap.cc:654] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.204514 18297 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.205219 18297 tablet_bootstrap.cc:654] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.205504 18298 tablet_bootstrap.cc:492] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.205600 18298 ts_tablet_manager.cc:1367] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:57:29.206166 18296 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.206146 18298 raft_consensus.cc:348] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.206243 18296 ts_tablet_manager.cc:1367] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240501 19:57:29.206553 18296 raft_consensus.cc:348] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.206615 18296 raft_consensus.cc:374] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.206634 18296 raft_consensus.cc:729] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.206727 18296 consensus_queue.cc:260] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.206986 18296 ts_tablet_manager.cc:1398] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.207170 18296 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.207276 18297 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.207351 18297 ts_tablet_manager.cc:1367] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.207753 18297 raft_consensus.cc:348] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.207854 18297 raft_consensus.cc:374] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.207899 18297 raft_consensus.cc:729] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.208045 18296 tablet_bootstrap.cc:654] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.208050 18297 consensus_queue.cc:260] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.208343 18297 ts_tablet_manager.cc:1398] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.208534 18297 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.206241 18298 raft_consensus.cc:374] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.208696 18298 raft_consensus.cc:729] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.208827 18298 consensus_queue.cc:260] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.209096 18298 ts_tablet_manager.cc:1398] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.209267 18298 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.209408 18297 tablet_bootstrap.cc:654] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.210172 18298 tablet_bootstrap.cc:654] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.210605 18296 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.210686 18296 ts_tablet_manager.cc:1367] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.211125 18296 raft_consensus.cc:348] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.211227 18296 raft_consensus.cc:374] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.211251 18298 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.211264 18296 raft_consensus.cc:729] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.211329 18298 ts_tablet_manager.cc:1367] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.211426 18296 consensus_queue.cc:260] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.211731 18296 ts_tablet_manager.cc:1398] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.211822 18298 raft_consensus.cc:348] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.211910 18298 raft_consensus.cc:374] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.211968 18298 raft_consensus.cc:729] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.212075 18298 consensus_queue.cc:260] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.212353 18298 ts_tablet_manager.cc:1398] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.212512 18297 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.212604 18297 ts_tablet_manager.cc:1367] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.212919 18297 raft_consensus.cc:348] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.213029 18297 raft_consensus.cc:374] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.213073 18297 raft_consensus.cc:729] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.212517 18298 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.213181 18297 consensus_queue.cc:260] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.213445 18297 ts_tablet_manager.cc:1398] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.214016 18298 tablet_bootstrap.cc:654] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.214501 18297 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.211921 18296 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.215407 18297 tablet_bootstrap.cc:654] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.215471 18296 tablet_bootstrap.cc:654] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.216173 18298 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.216249 18298 ts_tablet_manager.cc:1367] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 19:57:29.216449 18297 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.216531 18297 ts_tablet_manager.cc:1367] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.216672 18298 raft_consensus.cc:348] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.216766 18298 raft_consensus.cc:374] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.216809 18298 raft_consensus.cc:729] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.216921 18298 consensus_queue.cc:260] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.216938 18297 raft_consensus.cc:348] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.217042 18297 raft_consensus.cc:374] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.217090 18297 raft_consensus.cc:729] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.217236 18298 ts_tablet_manager.cc:1398] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.217200 18297 consensus_queue.cc:260] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.217453 18298 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.217589 18297 ts_tablet_manager.cc:1398] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.217635 18328 raft_consensus.cc:482] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.217696 18328 raft_consensus.cc:504] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.217743 18297 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.218041 18328 leader_election.cc:288] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.218447 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2749600d09ea4d459be9f981c5f082db" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.218537 18298 tablet_bootstrap.cc:654] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.218660 18297 tablet_bootstrap.cc:654] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.218770 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2749600d09ea4d459be9f981c5f082db" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.218889 18104 raft_consensus.cc:2454] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.219592 18298 tablet_bootstrap.cc:492] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
W20240501 19:57:29.219643 18146 leader_election.cc:341] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.219676 18298 ts_tablet_manager.cc:1367] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:29.219869 18145 leader_election.cc:302] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.219938 18297 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.220036 18297 ts_tablet_manager.cc:1367] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.220063 18328 raft_consensus.cc:2781] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.220129 18328 raft_consensus.cc:482] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.220067 18298 raft_consensus.cc:348] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.220167 18328 raft_consensus.cc:3037] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.220183 18298 raft_consensus.cc:374] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.220217 18298 raft_consensus.cc:729] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.220327 18298 consensus_queue.cc:260] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.220566 18298 ts_tablet_manager.cc:1398] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.220513 18297 raft_consensus.cc:348] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.220646 18297 raft_consensus.cc:374] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.220690 18297 raft_consensus.cc:729] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.220721 18298 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.220808 18297 consensus_queue.cc:260] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.221103 18297 ts_tablet_manager.cc:1398] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.221073 18328 raft_consensus.cc:504] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.221398 18328 leader_election.cc:288] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.221541 18297 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.221659 18298 tablet_bootstrap.cc:654] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.221851 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2749600d09ea4d459be9f981c5f082db" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.221947 18104 raft_consensus.cc:3037] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.222442 18297 tablet_bootstrap.cc:654] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.222625 18104 raft_consensus.cc:2454] T 2749600d09ea4d459be9f981c5f082db P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.222985 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2749600d09ea4d459be9f981c5f082db" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.223047 18145 leader_election.cc:302] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.223085 18255 raft_consensus.cc:3037] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.223611 18297 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.223693 18297 ts_tablet_manager.cc:1367] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.223954 18255 raft_consensus.cc:2454] T 2749600d09ea4d459be9f981c5f082db P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.224133 18297 raft_consensus.cc:348] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.224238 18297 raft_consensus.cc:374] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.224274 18297 raft_consensus.cc:729] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.224383 18297 consensus_queue.cc:260] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.224507 18328 raft_consensus.cc:2781] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.224599 18328 raft_consensus.cc:686] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.224674 18297 ts_tablet_manager.cc:1398] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.224720 18328 consensus_queue.cc:237] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.224866 18297 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.225273 18298 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.225411 18298 ts_tablet_manager.cc:1367] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.225668 18296 tablet_bootstrap.cc:492] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.225756 18296 ts_tablet_manager.cc:1367] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20240501 19:57:29.225868 18297 tablet_bootstrap.cc:654] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.226017 18298 raft_consensus.cc:348] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.226204 18298 raft_consensus.cc:374] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.226173 18296 raft_consensus.cc:348] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.226302 18298 raft_consensus.cc:729] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.226331 18296 raft_consensus.cc:374] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.226487 18296 raft_consensus.cc:729] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.226435 18000 catalog_manager.cc:5484] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.226601 18298 consensus_queue.cc:260] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.226758 18296 consensus_queue.cc:260] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.226972 18298 ts_tablet_manager.cc:1398] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.227246 18298 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.227674 18297 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.227771 18297 ts_tablet_manager.cc:1367] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 19:57:29.228211 18297 raft_consensus.cc:348] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.228314 18297 raft_consensus.cc:374] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.228354 18297 raft_consensus.cc:729] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.228452 18297 consensus_queue.cc:260] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.228641 18298 tablet_bootstrap.cc:654] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.228715 18297 ts_tablet_manager.cc:1398] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.228885 18297 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.229780 18298 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.229868 18298 ts_tablet_manager.cc:1367] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:57:29.229897 18297 tablet_bootstrap.cc:654] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.230018 18296 ts_tablet_manager.cc:1398] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.230196 18296 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.230298 18298 raft_consensus.cc:348] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.230407 18298 raft_consensus.cc:374] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.230443 18298 raft_consensus.cc:729] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.230567 18298 consensus_queue.cc:260] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.230818 18298 ts_tablet_manager.cc:1398] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.230937 18298 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.231294 18296 tablet_bootstrap.cc:654] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.231637 18298 tablet_bootstrap.cc:654] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.232491 18296 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.232570 18296 ts_tablet_manager.cc:1367] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.232815 18298 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.232885 18298 ts_tablet_manager.cc:1367] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.232975 18296 raft_consensus.cc:348] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.233180 18296 raft_consensus.cc:374] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.233222 18296 raft_consensus.cc:729] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.233294 18298 raft_consensus.cc:348] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.233383 18298 raft_consensus.cc:374] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.233354 18296 consensus_queue.cc:260] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.233413 18298 raft_consensus.cc:729] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.233561 18298 consensus_queue.cc:260] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.233685 18296 ts_tablet_manager.cc:1398] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.233840 18298 ts_tablet_manager.cc:1398] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.233922 18296 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.234192 18298 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.234829 18296 tablet_bootstrap.cc:654] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.234869 18298 tablet_bootstrap.cc:654] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.235883 18296 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.235971 18296 ts_tablet_manager.cc:1367] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.236210 18297 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.236295 18297 ts_tablet_manager.cc:1367] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240501 19:57:29.236387 18296 raft_consensus.cc:348] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.236459 18296 raft_consensus.cc:374] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.236478 18296 raft_consensus.cc:729] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.236564 18296 consensus_queue.cc:260] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.236702 18297 raft_consensus.cc:348] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.236791 18297 raft_consensus.cc:374] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.236824 18297 raft_consensus.cc:729] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.236838 18296 ts_tablet_manager.cc:1398] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.236919 18297 consensus_queue.cc:260] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.237177 18297 ts_tablet_manager.cc:1398] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.237213 18298 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.237288 18298 ts_tablet_manager.cc:1367] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.237329 18297 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.237460 18296 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.237710 18298 raft_consensus.cc:348] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.237794 18298 raft_consensus.cc:374] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.237823 18298 raft_consensus.cc:729] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.237941 18298 consensus_queue.cc:260] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.238188 18298 ts_tablet_manager.cc:1398] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.238266 18297 tablet_bootstrap.cc:654] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.238340 18298 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.238396 18296 tablet_bootstrap.cc:654] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.239212 18298 tablet_bootstrap.cc:654] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.239905 18296 tablet_bootstrap.cc:492] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.239987 18296 ts_tablet_manager.cc:1367] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.240384 18296 raft_consensus.cc:348] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.240499 18296 raft_consensus.cc:374] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.240550 18296 raft_consensus.cc:729] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.240677 18296 consensus_queue.cc:260] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.240980 18296 ts_tablet_manager.cc:1398] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.241155 18296 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.242117 18296 tablet_bootstrap.cc:654] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.242231 18297 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.242306 18297 ts_tablet_manager.cc:1367] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240501 19:57:29.242687 18297 raft_consensus.cc:348] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.242755 18297 raft_consensus.cc:374] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.242774 18297 raft_consensus.cc:729] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.242856 18297 consensus_queue.cc:260] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.243088 18297 ts_tablet_manager.cc:1398] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.243316 18297 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.243350 18296 tablet_bootstrap.cc:492] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.243412 18296 ts_tablet_manager.cc:1367] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.243808 18296 raft_consensus.cc:348] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.243897 18298 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.243925 18296 raft_consensus.cc:374] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.243960 18296 raft_consensus.cc:729] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.243981 18298 ts_tablet_manager.cc:1367] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.244100 18296 consensus_queue.cc:260] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.244221 18297 tablet_bootstrap.cc:654] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.244446 18298 raft_consensus.cc:348] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.244546 18298 raft_consensus.cc:374] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.244582 18298 raft_consensus.cc:729] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.244715 18298 consensus_queue.cc:260] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.244896 18296 ts_tablet_manager.cc:1398] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.245031 18298 ts_tablet_manager.cc:1398] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.245064 18296 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.245427 18298 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.246029 18296 tablet_bootstrap.cc:654] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.246260 18302 raft_consensus.cc:482] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.246328 18302 raft_consensus.cc:504] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.246511 18298 tablet_bootstrap.cc:654] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.246731 18302 leader_election.cc:288] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.246989 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.247236 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
W20240501 19:57:29.247577 18145 leader_election.cc:341] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.247680 18298 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.247757 18298 ts_tablet_manager.cc:1367] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.247877 18297 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
W20240501 19:57:29.247897 18146 leader_election.cc:341] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.247948 18297 ts_tablet_manager.cc:1367] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20240501 19:57:29.248217 18298 raft_consensus.cc:348] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.248306 18298 raft_consensus.cc:374] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.248339 18298 raft_consensus.cc:729] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.248368 18297 raft_consensus.cc:348] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.248488 18298 consensus_queue.cc:260] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.248466 18297 raft_consensus.cc:374] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.248842 18297 raft_consensus.cc:729] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.247953 18146 leader_election.cc:302] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.248992 18298 ts_tablet_manager.cc:1398] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.248966 18297 consensus_queue.cc:260] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.249018 18302 raft_consensus.cc:2726] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.249163 18298 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.249233 18297 ts_tablet_manager.cc:1398] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.249374 18297 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.250083 18298 tablet_bootstrap.cc:654] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.250255 18297 tablet_bootstrap.cc:654] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.251416 18297 tablet_bootstrap.cc:492] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.251513 18297 ts_tablet_manager.cc:1367] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.251927 18297 raft_consensus.cc:348] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.252027 18297 raft_consensus.cc:374] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.252050 18297 raft_consensus.cc:729] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.252166 18297 consensus_queue.cc:260] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.252399 18297 ts_tablet_manager.cc:1398] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.252439 18298 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.252523 18298 ts_tablet_manager.cc:1367] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 19:57:29.252581 18296 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.252604 18297 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.252650 18296 ts_tablet_manager.cc:1367] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20240501 19:57:29.252920 18298 raft_consensus.cc:348] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.253049 18298 raft_consensus.cc:374] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.253083 18298 raft_consensus.cc:729] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.253100 18296 raft_consensus.cc:348] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.253172 18296 raft_consensus.cc:374] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.253203 18296 raft_consensus.cc:729] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.253223 18298 consensus_queue.cc:260] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.253327 18296 consensus_queue.cc:260] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.253533 18298 ts_tablet_manager.cc:1398] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.253549 18297 tablet_bootstrap.cc:654] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.253690 18298 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.254587 18297 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.254626 18298 tablet_bootstrap.cc:654] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.254657 18297 ts_tablet_manager.cc:1367] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.255137 18296 ts_tablet_manager.cc:1398] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.255095 18297 raft_consensus.cc:348] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.255211 18297 raft_consensus.cc:374] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.255251 18297 raft_consensus.cc:729] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.255353 18297 consensus_queue.cc:260] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.255609 18297 ts_tablet_manager.cc:1398] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.255719 18296 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.255772 18297 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.256685 18297 tablet_bootstrap.cc:654] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.256774 18296 tablet_bootstrap.cc:654] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.258013 18298 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.258014 18297 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.258112 18297 ts_tablet_manager.cc:1367] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.258112 18298 ts_tablet_manager.cc:1367] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.258482 18296 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.258554 18296 ts_tablet_manager.cc:1367] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240501 19:57:29.258540 18297 raft_consensus.cc:348] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.258684 18297 raft_consensus.cc:374] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.258720 18297 raft_consensus.cc:729] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.258842 18297 consensus_queue.cc:260] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.259012 18296 raft_consensus.cc:348] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.259125 18296 raft_consensus.cc:374] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.259071 18297 ts_tablet_manager.cc:1398] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.259184 18296 raft_consensus.cc:729] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.258540 18298 raft_consensus.cc:348] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.259305 18296 consensus_queue.cc:260] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.259313 18297 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.259347 18298 raft_consensus.cc:374] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.259594 18296 ts_tablet_manager.cc:1398] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.259778 18296 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.260222 18297 tablet_bootstrap.cc:654] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.260632 18296 tablet_bootstrap.cc:654] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.259415 18298 raft_consensus.cc:729] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.260795 18298 consensus_queue.cc:260] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.261122 18298 ts_tablet_manager.cc:1398] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20240501 19:57:29.261332 18298 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.261758 18297 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.261842 18297 ts_tablet_manager.cc:1367] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:57:29.262266 18298 tablet_bootstrap.cc:654] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.262207 18297 raft_consensus.cc:348] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.262303 18297 raft_consensus.cc:374] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.262331 18297 raft_consensus.cc:729] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.262450 18297 consensus_queue.cc:260] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.262746 18297 ts_tablet_manager.cc:1398] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.262905 18297 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.263348 18298 tablet_bootstrap.cc:492] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.263417 18298 ts_tablet_manager.cc:1367] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.263792 18297 tablet_bootstrap.cc:654] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.263804 18298 raft_consensus.cc:348] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.263911 18298 raft_consensus.cc:374] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.263948 18298 raft_consensus.cc:729] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.264070 18298 consensus_queue.cc:260] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.264369 18298 ts_tablet_manager.cc:1398] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.264662 18298 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.264807 18297 tablet_bootstrap.cc:492] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.264880 18297 ts_tablet_manager.cc:1367] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.265295 18297 raft_consensus.cc:348] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.265390 18297 raft_consensus.cc:374] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.265425 18297 raft_consensus.cc:729] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.265584 18298 tablet_bootstrap.cc:654] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.265619 18297 consensus_queue.cc:260] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.266116 18331 raft_consensus.cc:482] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.266201 18331 raft_consensus.cc:504] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.266549 18331 leader_election.cc:288] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.266587 18298 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.266638 18297 ts_tablet_manager.cc:1398] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.266659 18298 ts_tablet_manager.cc:1367] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:29.266793 18297 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.266894 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b6624ee0145fdaa68b19890c88211" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.267006 18180 raft_consensus.cc:2454] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.267028 18298 raft_consensus.cc:348] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.267114 18298 raft_consensus.cc:374] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.267149 18298 raft_consensus.cc:729] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.267261 18298 consensus_queue.cc:260] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.267305 18218 leader_election.cc:302] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.267490 18298 ts_tablet_manager.cc:1398] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.267515 18304 raft_consensus.cc:2781] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.267570 18304 raft_consensus.cc:482] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.267608 18304 raft_consensus.cc:3037] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.267663 18297 tablet_bootstrap.cc:654] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.267668 18298 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.268604 18304 raft_consensus.cc:504] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.268738 18298 tablet_bootstrap.cc:654] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.268833 18296 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.268908 18296 ts_tablet_manager.cc:1367] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20240501 19:57:29.268962 18304 leader_election.cc:288] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.269345 18296 raft_consensus.cc:348] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.269451 18296 raft_consensus.cc:374] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.269521 18296 raft_consensus.cc:729] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.269606 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b6624ee0145fdaa68b19890c88211" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.269659 18296 consensus_queue.cc:260] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.269708 18180 raft_consensus.cc:3037] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.269919 18297 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.269949 18296 ts_tablet_manager.cc:1398] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.270009 18297 ts_tablet_manager.cc:1367] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.270094 18296 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.270365 18297 raft_consensus.cc:348] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.270468 18297 raft_consensus.cc:374] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.270500 18297 raft_consensus.cc:729] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.270632 18297 consensus_queue.cc:260] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.270687 18180 raft_consensus.cc:2454] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.270884 18297 ts_tablet_manager.cc:1398] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.270941 18218 leader_election.cc:302] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.271111 18297 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.271272 18298 tablet_bootstrap.cc:492] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.271338 18298 ts_tablet_manager.cc:1367] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240501 19:57:29.271646 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b6624ee0145fdaa68b19890c88211" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.271745 18298 raft_consensus.cc:348] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.271664 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73b6624ee0145fdaa68b19890c88211" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.271862 18298 raft_consensus.cc:374] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.271914 18298 raft_consensus.cc:729] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.271797 18104 raft_consensus.cc:2454] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.271981 18297 tablet_bootstrap.cc:654] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.272042 18298 consensus_queue.cc:260] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.272326 18298 ts_tablet_manager.cc:1398] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.272487 18298 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.273128 18297 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.273357 18297 ts_tablet_manager.cc:1367] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240501 19:57:29.273453 18331 raft_consensus.cc:2781] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.273382 18298 tablet_bootstrap.cc:654] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.273567 18331 raft_consensus.cc:686] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.273689 18331 consensus_queue.cc:237] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.274498 18297 raft_consensus.cc:348] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.274617 18297 raft_consensus.cc:374] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.274667 18297 raft_consensus.cc:729] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.274806 18297 consensus_queue.cc:260] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.275241 18302 raft_consensus.cc:482] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.275259 18298 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.275321 18302 raft_consensus.cc:504] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.275363 18298 ts_tablet_manager.cc:1367] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:57:29.275676 18302 leader_election.cc:288] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.275141 18297 ts_tablet_manager.cc:1398] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.275897 18298 raft_consensus.cc:348] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.275947 18297 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.276010 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d20a351a6427444e96bfc1828a990e92" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.276126 18104 raft_consensus.cc:2454] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.276396 18145 leader_election.cc:302] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.276468 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d20a351a6427444e96bfc1828a990e92" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.276633 18302 raft_consensus.cc:2781] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.276692 18302 raft_consensus.cc:482] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.276736 18302 raft_consensus.cc:3037] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
W20240501 19:57:29.276751 18146 leader_election.cc:341] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.276871 18297 tablet_bootstrap.cc:654] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.275676 17999 catalog_manager.cc:5484] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.276013 18298 raft_consensus.cc:374] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.277536 18298 raft_consensus.cc:729] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.277679 18302 raft_consensus.cc:504] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.277662 18298 consensus_queue.cc:260] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.277913 18298 ts_tablet_manager.cc:1398] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.277956 18302 leader_election.cc:288] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.278015 18328 raft_consensus.cc:482] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.278084 18328 raft_consensus.cc:504] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.278252 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d20a351a6427444e96bfc1828a990e92" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.278402 18328 leader_election.cc:288] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.278086 18298 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.278648 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d20a351a6427444e96bfc1828a990e92" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.278714 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.278743 18104 raft_consensus.cc:3037] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.278816 18103 raft_consensus.cc:2379] T e462158d407e44278078992c7b4f6a43 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ebf87da4c94e46a875293608ddad04 in current term 1: Already voted for candidate 030d4bb74d5046d98e41d25d74fce3f5 in this term.
W20240501 19:57:29.279042 18146 leader_election.cc:341] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.279287 18298 tablet_bootstrap.cc:654] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.279572 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e462158d407e44278078992c7b4f6a43" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.279608 18104 raft_consensus.cc:2454] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.279825 18145 leader_election.cc:302] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5
I20240501 19:57:29.280011 18296 tablet_bootstrap.cc:654] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.280047 18146 leader_election.cc:302] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.280238 18302 raft_consensus.cc:3037] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.280047 18328 raft_consensus.cc:2781] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.280784 18297 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.280784 18328 raft_consensus.cc:686] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.280884 18297 ts_tablet_manager.cc:1367] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240501 19:57:29.280941 18328 consensus_queue.cc:237] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.281100 18302 raft_consensus.cc:2726] T e462158d407e44278078992c7b4f6a43 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.281261 18297 raft_consensus.cc:348] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.281356 18297 raft_consensus.cc:374] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.281394 18297 raft_consensus.cc:729] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.281600 18297 consensus_queue.cc:260] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.281916 18297 ts_tablet_manager.cc:1398] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.282155 18328 raft_consensus.cc:482] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.282240 18328 raft_consensus.cc:504] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.282532 18328 leader_election.cc:288] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.282166 18297 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.282580 17999 catalog_manager.cc:5484] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.283218 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b3b0c7c59d4aa099df0a2f4cf8447e" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.283289 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b3b0c7c59d4aa099df0a2f4cf8447e" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.283532 18297 tablet_bootstrap.cc:654] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.283311 18255 raft_consensus.cc:2454] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.283393 18104 raft_consensus.cc:2454] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.284770 18145 leader_election.cc:302] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.285017 18296 tablet_bootstrap.cc:492] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.285085 18297 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.284814 18298 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.285179 18297 ts_tablet_manager.cc:1367] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.284929 18410 raft_consensus.cc:2781] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.285229 18410 raft_consensus.cc:482] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.285257 18298 ts_tablet_manager.cc:1367] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240501 19:57:29.285279 18296 ts_tablet_manager.cc:1367] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20240501 19:57:29.285610 18297 raft_consensus.cc:348] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.285708 18297 raft_consensus.cc:374] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.285676 18298 raft_consensus.cc:348] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.285781 18298 raft_consensus.cc:374] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.285871 18298 raft_consensus.cc:729] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.285902 18351 raft_consensus.cc:482] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.285961 18351 raft_consensus.cc:504] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.286005 18298 consensus_queue.cc:260] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.286294 18351 leader_election.cc:288] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.285790 18297 raft_consensus.cc:729] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.286494 18297 consensus_queue.cc:260] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.286636 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c252400bfbc43eda2e4f222ee9a4230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.286765 18297 ts_tablet_manager.cc:1398] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.286918 18297 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.286888 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c252400bfbc43eda2e4f222ee9a4230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
W20240501 19:57:29.286942 18218 leader_election.cc:341] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.285771 18410 raft_consensus.cc:3037] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.286993 18104 raft_consensus.cc:2454] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.286278 18298 ts_tablet_manager.cc:1398] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.287273 18220 leader_election.cc:302] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.287422 18331 raft_consensus.cc:2781] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.287446 18298 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.287467 18331 raft_consensus.cc:482] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.287510 18331 raft_consensus.cc:3037] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.287779 18297 tablet_bootstrap.cc:654] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.288344 18331 raft_consensus.cc:504] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.288497 18298 tablet_bootstrap.cc:654] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.288658 18331 leader_election.cc:288] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.288743 18328 raft_consensus.cc:482] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.288805 18328 raft_consensus.cc:504] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.289115 18328 leader_election.cc:288] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.289155 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c252400bfbc43eda2e4f222ee9a4230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.289239 18104 raft_consensus.cc:3037] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.289549 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d8d08f9d9140eba6cbb4e19b589e5a" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.289666 18103 raft_consensus.cc:2454] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.289851 18296 raft_consensus.cc:348] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.289907 18145 leader_election.cc:302] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.289953 18296 raft_consensus.cc:374] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.289992 18296 raft_consensus.cc:729] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.290076 18104 raft_consensus.cc:2454] T 9c252400bfbc43eda2e4f222ee9a4230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.290153 18296 consensus_queue.cc:260] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.290421 18302 raft_consensus.cc:2781] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.290477 18302 raft_consensus.cc:482] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.290454 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c252400bfbc43eda2e4f222ee9a4230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.290516 18302 raft_consensus.cc:3037] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.290587 18296 ts_tablet_manager.cc:1398] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
W20240501 19:57:29.290750 18218 leader_election.cc:341] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.290843 18220 leader_election.cc:302] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.291215 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d8d08f9d9140eba6cbb4e19b589e5a" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.291253 18296 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.291236 18302 raft_consensus.cc:504] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.291283 18331 raft_consensus.cc:2781] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.289546 18298 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.291340 18255 raft_consensus.cc:2454] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.291388 18331 raft_consensus.cc:686] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.291409 18298 ts_tablet_manager.cc:1367] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.291503 18331 consensus_queue.cc:237] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.291569 18302 leader_election.cc:288] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.291886 18298 raft_consensus.cc:348] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.292001 18298 raft_consensus.cc:374] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.292057 18298 raft_consensus.cc:729] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.292160 18298 consensus_queue.cc:260] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.292438 18298 ts_tablet_manager.cc:1398] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.292459 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d8d08f9d9140eba6cbb4e19b589e5a" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.292547 18104 raft_consensus.cc:3037] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.292596 18298 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.293315 18104 raft_consensus.cc:2454] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.293356 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d8d08f9d9140eba6cbb4e19b589e5a" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.293449 18255 raft_consensus.cc:3037] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.293576 18145 leader_election.cc:302] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.293725 18302 raft_consensus.cc:2781] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.293812 18302 raft_consensus.cc:686] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.293920 18302 consensus_queue.cc:237] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.294175 18298 tablet_bootstrap.cc:654] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.294843 18410 raft_consensus.cc:504] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.295122 18255 raft_consensus.cc:2454] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.295182 18410 leader_election.cc:288] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.295375 18298 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.295550 18298 ts_tablet_manager.cc:1367] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.295378 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b3b0c7c59d4aa099df0a2f4cf8447e" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.295699 18104 raft_consensus.cc:3037] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.295985 18298 raft_consensus.cc:348] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.296003 17999 catalog_manager.cc:5484] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.296128 18298 raft_consensus.cc:374] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.296165 18298 raft_consensus.cc:729] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.296306 18298 consensus_queue.cc:260] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.296339 18000 catalog_manager.cc:5484] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.296630 18298 ts_tablet_manager.cc:1398] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.296788 18298 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.297626 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5b3b0c7c59d4aa099df0a2f4cf8447e" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.297739 18255 raft_consensus.cc:3037] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.299734 18351 raft_consensus.cc:482] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.299825 18351 raft_consensus.cc:504] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.300149 18351 leader_election.cc:288] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.300364 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.300482 18103 raft_consensus.cc:2454] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.300662 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.300696 18220 leader_election.cc:302] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.300822 18351 raft_consensus.cc:2781] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.300887 18351 raft_consensus.cc:482] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.300940 18351 raft_consensus.cc:3037] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
W20240501 19:57:29.300921 18218 leader_election.cc:341] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.316614 18353 raft_consensus.cc:482] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.316725 18353 raft_consensus.cc:504] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.317124 18353 leader_election.cc:288] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.317442 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d466985b37e4bd58a2920fe6008093d" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.317498 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d466985b37e4bd58a2920fe6008093d" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.317627 18254 raft_consensus.cc:2454] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.317853 18297 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.317883 18070 leader_election.cc:302] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.317936 18297 ts_tablet_manager.cc:1367] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20240501 19:57:29.318079 18298 tablet_bootstrap.cc:654] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.318436 18255 raft_consensus.cc:2454] T f5b3b0c7c59d4aa099df0a2f4cf8447e P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.318527 18296 tablet_bootstrap.cc:654] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.318557 18351 raft_consensus.cc:504] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
W20240501 19:57:29.318761 18067 leader_election.cc:341] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.318915 18351 leader_election.cc:288] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.319007 18146 leader_election.cc:302] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.319191 18410 raft_consensus.cc:2781] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.319265 18410 raft_consensus.cc:686] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.319381 18410 consensus_queue.cc:237] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.319615 18298 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.319703 18298 ts_tablet_manager.cc:1367] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20240501 19:57:29.319733 18104 raft_consensus.cc:2454] T f5b3b0c7c59d4aa099df0a2f4cf8447e P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.320135 18298 raft_consensus.cc:348] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.320232 18298 raft_consensus.cc:374] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.320282 18298 raft_consensus.cc:729] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.320397 18298 consensus_queue.cc:260] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.320735 18298 ts_tablet_manager.cc:1398] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.320887 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.320909 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.321005 18103 raft_consensus.cc:3037] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.321043 18296 tablet_bootstrap.cc:492] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.321199 18296 ts_tablet_manager.cc:1367] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.001s
W20240501 19:57:29.321240 18218 leader_election.cc:341] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.321362 18353 raft_consensus.cc:2781] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.321408 18353 raft_consensus.cc:482] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.321336 18000 catalog_manager.cc:5484] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.318450 18297 raft_consensus.cc:348] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.321575 18297 raft_consensus.cc:374] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.321612 18297 raft_consensus.cc:729] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.321444 18353 raft_consensus.cc:3037] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.321924 18103 raft_consensus.cc:2454] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.322028 18298 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.322187 18220 leader_election.cc:302] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.322367 18351 raft_consensus.cc:2781] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.322456 18351 raft_consensus.cc:686] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.322589 18351 consensus_queue.cc:237] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.322634 18353 raft_consensus.cc:504] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.322870 18296 raft_consensus.cc:348] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.322959 18353 leader_election.cc:288] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.323015 18296 raft_consensus.cc:374] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.323176 18296 raft_consensus.cc:729] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.323029 18298 tablet_bootstrap.cc:654] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.323158 18304 raft_consensus.cc:482] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.323695 18304 raft_consensus.cc:504] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.323921 18296 consensus_queue.cc:260] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.323989 18304 leader_election.cc:288] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.324307 18296 ts_tablet_manager.cc:1398] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.324527 18296 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.324692 18298 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.324788 18298 ts_tablet_manager.cc:1367] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.324705 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac1c6a7daf194214a76880a6b4d1edc9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.324970 18103 raft_consensus.cc:2454] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.325209 18220 leader_election.cc:302] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.325276 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d466985b37e4bd58a2920fe6008093d" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.325388 18255 raft_consensus.cc:3037] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.325449 18304 raft_consensus.cc:2781] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.325548 18304 raft_consensus.cc:482] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.325599 18304 raft_consensus.cc:3037] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.326005 18296 tablet_bootstrap.cc:654] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.326164 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac1c6a7daf194214a76880a6b4d1edc9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.326282 18255 raft_consensus.cc:2454] T 3d466985b37e4bd58a2920fe6008093d P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.326414 18304 raft_consensus.cc:504] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.326632 18070 leader_election.cc:302] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.326737 18304 leader_election.cc:288] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.326277 18179 raft_consensus.cc:2454] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.325232 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d466985b37e4bd58a2920fe6008093d" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.327184 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac1c6a7daf194214a76880a6b4d1edc9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.327291 18103 raft_consensus.cc:3037] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.327414 18353 raft_consensus.cc:2781] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.327494 18353 raft_consensus.cc:686] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.327551 18000 catalog_manager.cc:5484] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.327615 18353 consensus_queue.cc:237] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.328111 18103 raft_consensus.cc:2454] T ac1c6a7daf194214a76880a6b4d1edc9 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.328333 18220 leader_election.cc:302] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.327155 18180 raft_consensus.cc:3037] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.328393 18297 consensus_queue.cc:260] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.328473 18304 raft_consensus.cc:2781] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.328549 18304 raft_consensus.cc:686] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.328684 18297 ts_tablet_manager.cc:1398] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.011s user 0.000s sys 0.001s
I20240501 19:57:29.328648 18304 consensus_queue.cc:237] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.328822 18297 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.328884 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac1c6a7daf194214a76880a6b4d1edc9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.328974 18179 raft_consensus.cc:3037] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.329258 18180 raft_consensus.cc:2454] T 3d466985b37e4bd58a2920fe6008093d P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.329661 18297 tablet_bootstrap.cc:654] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.325207 18298 raft_consensus.cc:348] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.330250 18298 raft_consensus.cc:374] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.330287 18298 raft_consensus.cc:729] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.330390 18298 consensus_queue.cc:260] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.330571 18179 raft_consensus.cc:2454] T ac1c6a7daf194214a76880a6b4d1edc9 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.330626 18297 tablet_bootstrap.cc:492] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.330680 18298 ts_tablet_manager.cc:1398] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:57:29.330690 18297 ts_tablet_manager.cc:1367] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.330848 18298 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.331211 18297 raft_consensus.cc:348] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.331310 18297 raft_consensus.cc:374] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.331348 18297 raft_consensus.cc:729] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.331462 18297 consensus_queue.cc:260] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.331784 18298 tablet_bootstrap.cc:654] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.331840 18297 ts_tablet_manager.cc:1398] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.332005 18297 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.332554 18296 tablet_bootstrap.cc:492] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.332520 17999 catalog_manager.cc:5484] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.332638 18296 ts_tablet_manager.cc:1367] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240501 19:57:29.333001 18297 tablet_bootstrap.cc:654] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.333073 18296 raft_consensus.cc:348] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.333015 18000 catalog_manager.cc:5484] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.333153 18296 raft_consensus.cc:374] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.333189 18296 raft_consensus.cc:729] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.333305 18296 consensus_queue.cc:260] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.333770 18296 ts_tablet_manager.cc:1398] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.334182 18296 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.334286 18353 raft_consensus.cc:482] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.334373 18353 raft_consensus.cc:504] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.334715 18353 leader_election.cc:288] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.335121 18296 tablet_bootstrap.cc:654] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.335357 18297 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.335427 18297 ts_tablet_manager.cc:1367] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.335443 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e999d46100b4fd39bbee770470a6967" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.335563 18179 raft_consensus.cc:2454] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.335757 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e999d46100b4fd39bbee770470a6967" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.335867 18255 raft_consensus.cc:2454] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.335883 18298 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.335883 18297 raft_consensus.cc:348] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.336064 18297 raft_consensus.cc:374] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.336113 18297 raft_consensus.cc:729] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.336167 18070 leader_election.cc:302] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.336217 18297 consensus_queue.cc:260] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.336318 18353 raft_consensus.cc:2781] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.336359 18353 raft_consensus.cc:482] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.336395 18353 raft_consensus.cc:3037] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.336527 18297 ts_tablet_manager.cc:1398] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.336702 18297 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.336967 18296 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.337059 18296 ts_tablet_manager.cc:1367] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.337294 18353 raft_consensus.cc:504] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.337446 18296 raft_consensus.cc:348] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.337589 18296 raft_consensus.cc:374] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.337612 18297 tablet_bootstrap.cc:654] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.337627 18296 raft_consensus.cc:729] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.337673 18353 leader_election.cc:288] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.337738 18296 consensus_queue.cc:260] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.338028 18296 ts_tablet_manager.cc:1398] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.335990 18298 ts_tablet_manager.cc:1367] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240501 19:57:29.338201 18296 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.338212 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e999d46100b4fd39bbee770470a6967" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.338346 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e999d46100b4fd39bbee770470a6967" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.338407 18179 raft_consensus.cc:3037] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.338490 18298 raft_consensus.cc:348] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.338605 18298 raft_consensus.cc:374] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.338637 18298 raft_consensus.cc:729] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.338768 18298 consensus_queue.cc:260] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.339088 18298 ts_tablet_manager.cc:1398] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.339234 18179 raft_consensus.cc:2454] T 8e999d46100b4fd39bbee770470a6967 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.339339 18298 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.339488 18067 leader_election.cc:302] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.338411 18255 raft_consensus.cc:3037] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.340278 18298 tablet_bootstrap.cc:654] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.340427 18255 raft_consensus.cc:2454] T 8e999d46100b4fd39bbee770470a6967 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.341009 18353 raft_consensus.cc:2781] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.341100 18296 tablet_bootstrap.cc:654] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.341102 18353 raft_consensus.cc:686] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.341321 18353 consensus_queue.cc:237] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.341671 18331 raft_consensus.cc:482] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.341758 18331 raft_consensus.cc:504] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.342098 18296 tablet_bootstrap.cc:492] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.342186 18296 ts_tablet_manager.cc:1367] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.342370 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c666aa80bd648f3b2857a2f19d6b26a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.342471 18103 raft_consensus.cc:2454] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.342519 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c666aa80bd648f3b2857a2f19d6b26a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.342621 18179 raft_consensus.cc:2454] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.342734 18296 raft_consensus.cc:348] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.342831 18296 raft_consensus.cc:374] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.342875 18296 raft_consensus.cc:729] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.342104 18331 leader_election.cc:288] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.342980 18296 consensus_queue.cc:260] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.343250 18296 ts_tablet_manager.cc:1398] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.343300 18000 catalog_manager.cc:5484] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.343412 18296 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.343413 18297 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.343526 18297 ts_tablet_manager.cc:1367] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240501 19:57:29.343946 18297 raft_consensus.cc:348] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.344038 18297 raft_consensus.cc:374] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.344069 18297 raft_consensus.cc:729] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.344184 18297 consensus_queue.cc:260] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.344249 18296 tablet_bootstrap.cc:654] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.344542 18297 ts_tablet_manager.cc:1398] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.344695 18297 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.342743 18220 leader_election.cc:302] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.345571 18331 raft_consensus.cc:2781] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.345630 18331 raft_consensus.cc:482] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.345676 18331 raft_consensus.cc:3037] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.345767 18297 tablet_bootstrap.cc:654] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.346076 18298 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.346112 18296 tablet_bootstrap.cc:492] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.346158 18298 ts_tablet_manager.cc:1367] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240501 19:57:29.346181 18296 ts_tablet_manager.cc:1367] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.346495 18298 raft_consensus.cc:348] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.346562 18298 raft_consensus.cc:374] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.346581 18298 raft_consensus.cc:729] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.346544 18331 raft_consensus.cc:504] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.346609 18296 raft_consensus.cc:348] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.346676 18296 raft_consensus.cc:374] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.346741 18296 raft_consensus.cc:729] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.346833 18331 leader_election.cc:288] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.346856 18296 consensus_queue.cc:260] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.347172 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c666aa80bd648f3b2857a2f19d6b26a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.347292 18179 raft_consensus.cc:3037] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.347419 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c666aa80bd648f3b2857a2f19d6b26a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.347528 18103 raft_consensus.cc:3037] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.347810 18297 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.347939 18297 ts_tablet_manager.cc:1367] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.346673 18298 consensus_queue.cc:260] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.348150 18179 raft_consensus.cc:2454] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.348304 18298 ts_tablet_manager.cc:1398] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.348551 18298 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.348559 18297 raft_consensus.cc:348] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.348793 18297 raft_consensus.cc:374] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.348874 18297 raft_consensus.cc:729] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.349079 18297 consensus_queue.cc:260] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.348647 18218 leader_election.cc:302] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.349339 18331 raft_consensus.cc:2781] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.349422 18331 raft_consensus.cc:686] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.349575 18331 consensus_queue.cc:237] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.348307 18103 raft_consensus.cc:2454] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.349761 18297 ts_tablet_manager.cc:1398] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.349625 18298 tablet_bootstrap.cc:654] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.350008 18297 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.347180 18296 ts_tablet_manager.cc:1398] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.350347 18296 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.351154 18298 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.351241 18298 ts_tablet_manager.cc:1367] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.351357 18297 tablet_bootstrap.cc:654] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.351641 18298 raft_consensus.cc:348] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.351751 18298 raft_consensus.cc:374] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.351795 18298 raft_consensus.cc:729] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.351929 18298 consensus_queue.cc:260] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.352265 18298 ts_tablet_manager.cc:1398] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.352442 18298 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.352546 18297 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.352636 18297 ts_tablet_manager.cc:1367] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.353040 18296 tablet_bootstrap.cc:654] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.353091 18297 raft_consensus.cc:348] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.353896 18297 raft_consensus.cc:374] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.353937 18297 raft_consensus.cc:729] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.353407 18298 tablet_bootstrap.cc:654] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.354063 18297 consensus_queue.cc:260] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.354354 18297 ts_tablet_manager.cc:1398] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.354553 18297 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.355201 18296 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.355248 18298 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.355283 18296 ts_tablet_manager.cc:1367] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.355221 18000 catalog_manager.cc:5484] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.355324 18298 ts_tablet_manager.cc:1367] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.355650 18297 tablet_bootstrap.cc:654] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.355762 18353 raft_consensus.cc:482] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.355894 18353 raft_consensus.cc:504] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.356238 18353 leader_election.cc:288] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.356534 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.356621 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.356648 18255 raft_consensus.cc:2454] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.356699 18179 raft_consensus.cc:2454] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.356889 18067 leader_election.cc:302] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.357151 18353 raft_consensus.cc:2781] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.357211 18353 raft_consensus.cc:482] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.357275 18353 raft_consensus.cc:3037] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.357228 18297 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.357486 18297 ts_tablet_manager.cc:1367] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240501 19:57:29.355660 18296 raft_consensus.cc:348] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.357755 18296 raft_consensus.cc:374] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.357790 18296 raft_consensus.cc:729] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.357857 18297 raft_consensus.cc:348] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.357885 18296 consensus_queue.cc:260] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.355753 18298 raft_consensus.cc:348] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.358000 18298 raft_consensus.cc:374] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.358039 18298 raft_consensus.cc:729] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.358150 18298 consensus_queue.cc:260] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.358201 18296 ts_tablet_manager.cc:1398] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.358377 18296 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.358209 18353 raft_consensus.cc:504] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.358438 18298 ts_tablet_manager.cc:1398] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.358593 18298 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.358654 18353 leader_election.cc:288] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.358983 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.359067 18179 raft_consensus.cc:3037] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.359292 18296 tablet_bootstrap.cc:654] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.359514 18298 tablet_bootstrap.cc:654] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.359899 18179 raft_consensus.cc:2454] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.360283 18297 raft_consensus.cc:374] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.360338 18297 raft_consensus.cc:729] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.360406 18067 leader_election.cc:302] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.360448 18297 consensus_queue.cc:260] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.360344 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "357676875d3b4ce190161065f07c507f" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.360620 18255 raft_consensus.cc:3037] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.360761 18296 tablet_bootstrap.cc:492] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.360836 18354 raft_consensus.cc:2781] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.360951 18354 raft_consensus.cc:686] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.360970 18296 ts_tablet_manager.cc:1367] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.361075 18354 consensus_queue.cc:237] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.361450 18255 raft_consensus.cc:2454] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.361641 18296 raft_consensus.cc:348] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.361864 18296 raft_consensus.cc:374] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.361953 18296 raft_consensus.cc:729] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.361999 18298 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.360776 18297 ts_tablet_manager.cc:1398] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20240501 19:57:29.362099 18298 ts_tablet_manager.cc:1367] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240501 19:57:29.362228 18297 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.362493 18298 raft_consensus.cc:348] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.362600 18298 raft_consensus.cc:374] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.362643 18298 raft_consensus.cc:729] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.362764 18298 consensus_queue.cc:260] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.362999 18298 ts_tablet_manager.cc:1398] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.363150 18298 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.363219 18297 tablet_bootstrap.cc:654] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.363312 18000 catalog_manager.cc:5484] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.363910 18296 consensus_queue.cc:260] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.364073 18298 tablet_bootstrap.cc:654] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.364289 18296 ts_tablet_manager.cc:1398] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.364475 18296 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.365339 18296 tablet_bootstrap.cc:654] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.366523 18297 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.366611 18297 ts_tablet_manager.cc:1367] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.366766 18296 tablet_bootstrap.cc:492] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.366801 18298 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.366847 18296 ts_tablet_manager.cc:1367] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.366865 18298 ts_tablet_manager.cc:1367] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.367012 18297 raft_consensus.cc:348] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.367106 18297 raft_consensus.cc:374] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.367137 18297 raft_consensus.cc:729] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.367255 18298 raft_consensus.cc:348] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.367239 18297 consensus_queue.cc:260] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.367344 18298 raft_consensus.cc:374] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.367377 18298 raft_consensus.cc:729] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.367554 18297 ts_tablet_manager.cc:1398] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.367596 18296 raft_consensus.cc:348] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.367681 18296 raft_consensus.cc:374] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.367722 18296 raft_consensus.cc:729] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.367725 18297 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.367846 18296 consensus_queue.cc:260] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.368109 18296 ts_tablet_manager.cc:1398] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.368295 18296 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.368626 18297 tablet_bootstrap.cc:654] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.369418 18296 tablet_bootstrap.cc:654] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.369654 18297 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.369736 18297 ts_tablet_manager.cc:1367] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.370054 18298 consensus_queue.cc:260] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.370143 18297 raft_consensus.cc:348] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.370226 18297 raft_consensus.cc:374] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.370268 18297 raft_consensus.cc:729] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.370345 18298 ts_tablet_manager.cc:1398] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.370383 18297 consensus_queue.cc:260] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.370527 18298 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.370659 18297 ts_tablet_manager.cc:1398] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.370815 18297 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.371404 18298 tablet_bootstrap.cc:654] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.371721 18297 tablet_bootstrap.cc:654] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.372602 18298 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.372686 18298 ts_tablet_manager.cc:1367] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.373119 18297 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.373159 18298 raft_consensus.cc:348] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.373212 18297 ts_tablet_manager.cc:1367] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.373268 18298 raft_consensus.cc:374] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.373307 18298 raft_consensus.cc:729] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.373438 18298 consensus_queue.cc:260] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.373803 18298 ts_tablet_manager.cc:1398] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.373982 18298 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.374203 18296 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.374168 18297 raft_consensus.cc:348] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.374289 18297 raft_consensus.cc:374] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.374347 18297 raft_consensus.cc:729] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.374512 18297 consensus_queue.cc:260] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.374308 18296 ts_tablet_manager.cc:1367] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.374820 18297 ts_tablet_manager.cc:1398] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.374868 18298 tablet_bootstrap.cc:654] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.375013 18297 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.375041 18296 raft_consensus.cc:348] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.375134 18296 raft_consensus.cc:374] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.375164 18296 raft_consensus.cc:729] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.375260 18296 consensus_queue.cc:260] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.375545 18296 ts_tablet_manager.cc:1398] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.375864 18297 tablet_bootstrap.cc:654] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.376281 18296 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.376969 18296 tablet_bootstrap.cc:654] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.378031 18296 tablet_bootstrap.cc:492] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.378129 18296 ts_tablet_manager.cc:1367] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.378280 18297 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.378360 18297 ts_tablet_manager.cc:1367] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.378562 18296 raft_consensus.cc:348] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.378666 18296 raft_consensus.cc:374] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.378706 18296 raft_consensus.cc:729] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.378751 18297 raft_consensus.cc:348] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.378841 18296 consensus_queue.cc:260] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.378844 18297 raft_consensus.cc:374] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.379037 18304 raft_consensus.cc:482] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.379123 18304 raft_consensus.cc:504] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.379202 18298 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.379271 18298 ts_tablet_manager.cc:1367] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240501 19:57:29.379470 18304 leader_election.cc:288] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.379739 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5601fd42b321477ab637142f5d4a196b" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.379828 18298 raft_consensus.cc:348] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.379923 18298 raft_consensus.cc:374] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.379956 18298 raft_consensus.cc:729] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.379040 18297 raft_consensus.cc:729] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.380066 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5601fd42b321477ab637142f5d4a196b" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.379868 18103 raft_consensus.cc:2454] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.380201 18179 raft_consensus.cc:2454] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.380216 18297 consensus_queue.cc:260] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.380383 18220 leader_election.cc:302] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.380066 18298 consensus_queue.cc:260] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.380520 18304 raft_consensus.cc:2781] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.380532 18297 ts_tablet_manager.cc:1398] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.380721 18304 raft_consensus.cc:482] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.380756 18298 ts_tablet_manager.cc:1398] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.380879 18297 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.380916 18298 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.380769 18304 raft_consensus.cc:3037] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.381819 18297 tablet_bootstrap.cc:654] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.381992 18298 tablet_bootstrap.cc:654] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.382571 18304 raft_consensus.cc:504] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.382787 18297 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.382880 18297 ts_tablet_manager.cc:1367] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.382939 18304 leader_election.cc:288] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.383211 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5601fd42b321477ab637142f5d4a196b" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.383329 18179 raft_consensus.cc:3037] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.383291 18297 raft_consensus.cc:348] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.383395 18297 raft_consensus.cc:374] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.383426 18297 raft_consensus.cc:729] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.383544 18297 consensus_queue.cc:260] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.383828 18297 ts_tablet_manager.cc:1398] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.379266 18296 ts_tablet_manager.cc:1398] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.383998 18296 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.383998 18297 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.384153 18298 tablet_bootstrap.cc:492] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.384233 18298 ts_tablet_manager.cc:1367] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.384477 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5601fd42b321477ab637142f5d4a196b" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.384575 18103 raft_consensus.cc:3037] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.384660 18298 raft_consensus.cc:348] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.384754 18298 raft_consensus.cc:374] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.384785 18298 raft_consensus.cc:729] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.384878 18298 consensus_queue.cc:260] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.385005 18297 tablet_bootstrap.cc:654] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.385123 18298 ts_tablet_manager.cc:1398] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.385293 18298 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.385393 18103 raft_consensus.cc:2454] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.385005 18296 tablet_bootstrap.cc:654] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.386000 18297 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.386072 18297 ts_tablet_manager.cc:1367] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.386180 18298 tablet_bootstrap.cc:654] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.386371 18297 raft_consensus.cc:348] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.386443 18297 raft_consensus.cc:374] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.386463 18297 raft_consensus.cc:729] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.386582 18297 consensus_queue.cc:260] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.384236 18179 raft_consensus.cc:2454] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.386782 18297 ts_tablet_manager.cc:1398] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.386942 18297 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.386969 18218 leader_election.cc:302] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.387126 18304 raft_consensus.cc:2781] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.387192 18304 raft_consensus.cc:686] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.387308 18304 consensus_queue.cc:237] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.387899 18297 tablet_bootstrap.cc:654] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.388155 18302 raft_consensus.cc:482] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.388231 18302 raft_consensus.cc:504] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.388563 18302 leader_election.cc:288] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.388906 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e3f8dc551384672a732e4f400999213" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.389007 18255 raft_consensus.cc:2454] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.389119 18296 tablet_bootstrap.cc:492] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.389186 18296 ts_tablet_manager.cc:1367] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.389169 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e3f8dc551384672a732e4f400999213" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.389253 18103 raft_consensus.cc:2454] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.389550 18145 leader_election.cc:302] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.389642 18296 raft_consensus.cc:348] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.389750 18296 raft_consensus.cc:374] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.389786 18296 raft_consensus.cc:729] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.389688 18302 raft_consensus.cc:2781] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.389926 18302 raft_consensus.cc:482] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.389883 18296 consensus_queue.cc:260] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.390007 18302 raft_consensus.cc:3037] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.390250 18296 ts_tablet_manager.cc:1398] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.390427 18296 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.390815 18302 raft_consensus.cc:504] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.391158 18302 leader_election.cc:288] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.391537 18296 tablet_bootstrap.cc:654] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.391587 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e3f8dc551384672a732e4f400999213" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.391692 18103 raft_consensus.cc:3037] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.391984 18297 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.392123 18297 ts_tablet_manager.cc:1367] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240501 19:57:29.392323 17999 catalog_manager.cc:5484] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.392553 18103 raft_consensus.cc:2454] T 5e3f8dc551384672a732e4f400999213 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.392638 18296 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.392724 18296 ts_tablet_manager.cc:1367] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.392830 18297 raft_consensus.cc:348] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.392971 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e3f8dc551384672a732e4f400999213" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.393028 18297 raft_consensus.cc:374] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.393162 18297 raft_consensus.cc:729] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.393208 18145 leader_election.cc:302] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.393240 18296 raft_consensus.cc:348] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.393352 18296 raft_consensus.cc:374] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.393404 18296 raft_consensus.cc:729] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.393440 18298 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.393543 18298 ts_tablet_manager.cc:1367] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240501 19:57:29.393064 18255 raft_consensus.cc:3037] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.394002 18298 raft_consensus.cc:348] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.394112 18298 raft_consensus.cc:374] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.394065 18296 consensus_queue.cc:260] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.394145 18298 raft_consensus.cc:729] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.394241 18298 consensus_queue.cc:260] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.394333 18296 ts_tablet_manager.cc:1398] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.394556 18296 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.394608 18298 ts_tablet_manager.cc:1398] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.394784 18298 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.395006 18255 raft_consensus.cc:2454] T 5e3f8dc551384672a732e4f400999213 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.395498 18302 raft_consensus.cc:2781] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.395579 18296 tablet_bootstrap.cc:654] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.395772 18298 tablet_bootstrap.cc:654] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.393533 18297 consensus_queue.cc:260] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.396404 18297 ts_tablet_manager.cc:1398] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240501 19:57:29.396621 18297 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.395588 18302 raft_consensus.cc:686] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.396849 18302 consensus_queue.cc:237] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.397459 18297 tablet_bootstrap.cc:654] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.398368 18296 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.398439 18296 ts_tablet_manager.cc:1367] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 19:57:29.398821 18296 raft_consensus.cc:348] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.398936 18296 raft_consensus.cc:374] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.398988 18296 raft_consensus.cc:729] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.399108 18296 consensus_queue.cc:260] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.399189 18297 tablet_bootstrap.cc:492] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.399261 18297 ts_tablet_manager.cc:1367] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240501 19:57:29.399358 18296 ts_tablet_manager.cc:1398] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.399515 18296 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.399641 18297 raft_consensus.cc:348] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.399729 18297 raft_consensus.cc:374] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.399757 18297 raft_consensus.cc:729] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.399860 18297 consensus_queue.cc:260] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.400138 18297 ts_tablet_manager.cc:1398] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.400316 18297 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.400451 18296 tablet_bootstrap.cc:654] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.401214 18297 tablet_bootstrap.cc:654] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.401224 17999 catalog_manager.cc:5484] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.401615 18298 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.401711 18298 ts_tablet_manager.cc:1367] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20240501 19:57:29.402082 18298 raft_consensus.cc:348] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.402168 18298 raft_consensus.cc:374] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.402185 18296 tablet_bootstrap.cc:492] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.402206 18298 raft_consensus.cc:729] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.402266 18296 ts_tablet_manager.cc:1367] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.402318 18298 consensus_queue.cc:260] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.402606 18298 ts_tablet_manager.cc:1398] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.402689 18296 raft_consensus.cc:348] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.402786 18296 raft_consensus.cc:374] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.402819 18296 raft_consensus.cc:729] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.402873 18298 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.402927 18296 consensus_queue.cc:260] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.403177 18296 ts_tablet_manager.cc:1398] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.403339 18296 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.403748 18298 tablet_bootstrap.cc:654] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.404284 18353 raft_consensus.cc:482] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.404366 18353 raft_consensus.cc:504] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.404639 18296 tablet_bootstrap.cc:654] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.404722 18353 leader_election.cc:288] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.404753 18298 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.404820 18298 ts_tablet_manager.cc:1367] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.405066 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c343b15b92a4d84a539e3122ed85ef2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.405164 18255 raft_consensus.cc:2454] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.405273 18298 raft_consensus.cc:348] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.405365 18298 raft_consensus.cc:374] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.405398 18298 raft_consensus.cc:729] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.405512 18298 consensus_queue.cc:260] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.405567 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c343b15b92a4d84a539e3122ed85ef2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.405648 18179 raft_consensus.cc:2454] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.405791 18298 ts_tablet_manager.cc:1398] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.405822 18297 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.405896 18297 ts_tablet_manager.cc:1367] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20240501 19:57:29.405956 18070 leader_election.cc:302] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.406123 18353 raft_consensus.cc:2781] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.406175 18353 raft_consensus.cc:482] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.406213 18353 raft_consensus.cc:3037] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.406265 18297 raft_consensus.cc:348] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.406350 18297 raft_consensus.cc:374] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.406390 18297 raft_consensus.cc:729] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.406486 18297 consensus_queue.cc:260] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.406715 18297 ts_tablet_manager.cc:1398] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.406872 18297 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.406991 18331 raft_consensus.cc:482] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.407073 18331 raft_consensus.cc:504] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.407120 18353 raft_consensus.cc:504] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.407383 18331 leader_election.cc:288] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.407449 18353 leader_election.cc:288] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.407843 18297 tablet_bootstrap.cc:654] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.407819 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9f7b594299448a09fa4aefe5af61230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.407914 18103 raft_consensus.cc:2454] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.407954 18331 raft_consensus.cc:482] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.408169 18220 leader_election.cc:302] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.408340 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9f7b594299448a09fa4aefe5af61230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.408398 18304 raft_consensus.cc:2781] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.408449 18180 raft_consensus.cc:2454] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.408537 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c343b15b92a4d84a539e3122ed85ef2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.408613 18179 raft_consensus.cc:3037] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.408831 18298 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.408128 18331 raft_consensus.cc:504] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.410465 18331 leader_election.cc:288] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.409464 18179 raft_consensus.cc:2454] T 7c343b15b92a4d84a539e3122ed85ef2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.409509 18302 raft_consensus.cc:482] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.408449 18304 raft_consensus.cc:482] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.409790 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c343b15b92a4d84a539e3122ed85ef2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.410681 18304 raft_consensus.cc:3037] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.410670 18302 raft_consensus.cc:504] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.410728 18255 raft_consensus.cc:3037] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.410969 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.411096 18103 raft_consensus.cc:2379] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030d4bb74d5046d98e41d25d74fce3f5 in current term 1: Already voted for candidate d7ebf87da4c94e46a875293608ddad04 in this term.
I20240501 19:57:29.411213 18067 leader_election.cc:302] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.410990 18302 leader_election.cc:288] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.411568 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c406ab4a99549fabe2bd60919a725a8" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.411636 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c406ab4a99549fabe2bd60919a725a8" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.411690 18255 raft_consensus.cc:2454] T 7c343b15b92a4d84a539e3122ed85ef2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.411689 18103 raft_consensus.cc:2454] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.411764 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a43eb46633f4a25b08b84779c0d64ae" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.411689 18354 raft_consensus.cc:2781] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.409795 18297 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.411935 18354 raft_consensus.cc:686] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.411984 18297 ts_tablet_manager.cc:1367] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240501 19:57:29.411582 18304 raft_consensus.cc:504] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.412050 18354 consensus_queue.cc:237] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.412274 18302 raft_consensus.cc:482] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.412314 18304 leader_election.cc:288] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.412338 18302 raft_consensus.cc:504] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.412364 18297 raft_consensus.cc:348] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.412459 18297 raft_consensus.cc:374] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.412504 18297 raft_consensus.cc:729] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.412600 18354 raft_consensus.cc:482] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.412632 18302 leader_election.cc:288] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.412679 18354 raft_consensus.cc:504] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.413007 18354 leader_election.cc:288] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.411737 18254 raft_consensus.cc:2454] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.413570 18298 tablet_bootstrap.cc:654] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.413645 18218 leader_election.cc:302] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5; no voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.413961 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7bd95fff5b4435bbb1825d1fb0ede2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.414028 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9f7b594299448a09fa4aefe5af61230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.414070 18254 raft_consensus.cc:2454] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.414106 18103 raft_consensus.cc:3037] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.412604 18297 consensus_queue.cc:260] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.414342 18070 leader_election.cc:302] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.414463 18297 ts_tablet_manager.cc:1398] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.414609 18297 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.414646 18354 raft_consensus.cc:2781] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.414716 18354 raft_consensus.cc:482] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.414767 18354 raft_consensus.cc:3037] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.414908 18103 raft_consensus.cc:2454] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.415475 18354 raft_consensus.cc:504] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.415697 18297 tablet_bootstrap.cc:654] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.415648 17999 catalog_manager.cc:5484] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.415807 18354 leader_election.cc:288] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.416095 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7bd95fff5b4435bbb1825d1fb0ede2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.416141 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7bd95fff5b4435bbb1825d1fb0ede2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.416206 18180 raft_consensus.cc:3037] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.416302 18220 leader_election.cc:302] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.416525 18146 leader_election.cc:302] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.416677 18331 raft_consensus.cc:3037] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.417006 18297 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.417094 18180 raft_consensus.cc:2454] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.417217 18297 ts_tablet_manager.cc:1367] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.417376 18067 leader_election.cc:302] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.417424 18302 raft_consensus.cc:2781] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.417510 18331 raft_consensus.cc:2726] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.416206 18254 raft_consensus.cc:3037] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.417683 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d7bd95fff5b4435bbb1825d1fb0ede2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.417749 18351 raft_consensus.cc:482] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.417791 18179 raft_consensus.cc:2362] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1. Re-sending same reply.
I20240501 19:57:29.417819 18351 raft_consensus.cc:504] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.418118 18351 leader_election.cc:288] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.418246 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9f7b594299448a09fa4aefe5af61230" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.418313 18351 raft_consensus.cc:482] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.418329 18179 raft_consensus.cc:3037] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.418392 18351 raft_consensus.cc:504] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.418594 18254 raft_consensus.cc:2454] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.418677 18351 leader_election.cc:288] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.417613 18305 raft_consensus.cc:2781] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.418812 18305 raft_consensus.cc:686] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.417510 18302 raft_consensus.cc:482] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.419018 18302 raft_consensus.cc:3037] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.418975 18305 consensus_queue.cc:237] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.419195 18179 raft_consensus.cc:2454] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.417603 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d386ffed734860bb531b7b950da488" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.419829 18255 raft_consensus.cc:2454] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.419926 18302 raft_consensus.cc:504] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.419989 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.420213 18302 leader_election.cc:288] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.417644 18331 raft_consensus.cc:2781] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.420420 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.420449 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c406ab4a99549fabe2bd60919a725a8" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.420523 18179 raft_consensus.cc:2454] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.420547 18104 raft_consensus.cc:3037] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.420433 18331 raft_consensus.cc:686] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.420756 18331 consensus_queue.cc:237] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.420843 18146 leader_election.cc:302] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.421012 18103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d386ffed734860bb531b7b950da488" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.421097 18103 raft_consensus.cc:2454] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.421216 18302 raft_consensus.cc:482] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.421289 18302 raft_consensus.cc:504] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.420763 18298 tablet_bootstrap.cc:492] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.421391 18104 raft_consensus.cc:2454] T 2c406ab4a99549fabe2bd60919a725a8 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.421602 18218 leader_election.cc:302] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.421650 18302 leader_election.cc:288] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.421718 18302 raft_consensus.cc:2781] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.421738 18331 raft_consensus.cc:2781] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.421761 18302 raft_consensus.cc:482] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.421779 18331 raft_consensus.cc:482] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.421803 18302 raft_consensus.cc:3037] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.421821 18331 raft_consensus.cc:3037] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.421979 17999 catalog_manager.cc:5484] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.422093 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c406ab4a99549fabe2bd60919a725a8" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.422183 18255 raft_consensus.cc:3037] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.422554 18331 raft_consensus.cc:504] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.422896 18331 leader_election.cc:288] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.422947 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfee7a6c48e487f84b2dd8c708314cd" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.422971 18255 raft_consensus.cc:2454] T 2c406ab4a99549fabe2bd60919a725a8 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.423038 18254 raft_consensus.cc:2454] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.423219 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.423298 18146 leader_election.cc:302] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.423339 18102 raft_consensus.cc:2454] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.423449 18146 leader_election.cc:302] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.423542 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35e7e35b622f44e08a530601ac203994" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.423583 18328 raft_consensus.cc:2781] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.423664 18101 raft_consensus.cc:2379] T 35e7e35b622f44e08a530601ac203994 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 030d4bb74d5046d98e41d25d74fce3f5 in current term 1: Already voted for candidate d7ebf87da4c94e46a875293608ddad04 in this term.
I20240501 19:57:29.421425 18298 ts_tablet_manager.cc:1367] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240501 19:57:29.423679 18000 catalog_manager.cc:5484] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.423807 18410 raft_consensus.cc:2781] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.423847 18410 raft_consensus.cc:482] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.423882 18410 raft_consensus.cc:3037] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.418114 18297 raft_consensus.cc:348] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.424181 18298 raft_consensus.cc:348] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.424286 18298 raft_consensus.cc:374] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.424326 18298 raft_consensus.cc:729] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.424435 18298 consensus_queue.cc:260] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.424510 18296 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.424607 18296 ts_tablet_manager.cc:1367] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20240501 19:57:29.423741 18328 raft_consensus.cc:686] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.424690 18298 ts_tablet_manager.cc:1398] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.424800 18328 consensus_queue.cc:237] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.424865 18298 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.425002 18296 raft_consensus.cc:348] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.425083 18296 raft_consensus.cc:374] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.425115 18296 raft_consensus.cc:729] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.425194 18296 consensus_queue.cc:260] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.425609 18296 ts_tablet_manager.cc:1398] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.425861 18298 tablet_bootstrap.cc:654] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.426079 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.426172 18101 raft_consensus.cc:3037] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.426651 18304 raft_consensus.cc:482] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.426726 18304 raft_consensus.cc:504] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.427054 18304 leader_election.cc:288] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.424196 18297 raft_consensus.cc:374] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.427284 18297 raft_consensus.cc:729] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.427297 18101 raft_consensus.cc:2454] T 4fee40f19ff4468aa38a3d28b189ee56 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.427431 18297 consensus_queue.cc:260] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.424679 18410 raft_consensus.cc:504] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.427836 18410 leader_election.cc:288] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.428211 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfee7a6c48e487f84b2dd8c708314cd" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.428251 18298 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.428427 18298 ts_tablet_manager.cc:1367] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240501 19:57:29.428314 18254 raft_consensus.cc:3037] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.428918 18298 raft_consensus.cc:348] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.429065 18298 raft_consensus.cc:374] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.429147 18298 raft_consensus.cc:729] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.429257 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09a85049bcb54ab3997e07ab7f564c77" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.429409 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfee7a6c48e487f84b2dd8c708314cd" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.429318 18298 consensus_queue.cc:260] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.429690 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2cfee7a6c48e487f84b2dd8c708314cd" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.429512 18102 raft_consensus.cc:3037] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.429842 18298 ts_tablet_manager.cc:1398] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.430094 18298 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
W20240501 19:57:29.430229 18218 leader_election.cc:341] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.430349 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fee40f19ff4468aa38a3d28b189ee56" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.430460 18179 raft_consensus.cc:3037] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.430562 18000 catalog_manager.cc:5484] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.430752 18102 raft_consensus.cc:2454] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.429340 18353 raft_consensus.cc:482] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.430917 18353 raft_consensus.cc:504] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.431260 18179 raft_consensus.cc:2454] T 4fee40f19ff4468aa38a3d28b189ee56 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.431303 18353 leader_election.cc:288] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.431525 18218 leader_election.cc:302] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.431725 18304 raft_consensus.cc:2781] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.431811 18304 raft_consensus.cc:686] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.431947 18304 consensus_queue.cc:237] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.432015 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.429291 18254 raft_consensus.cc:2454] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.432528 18145 leader_election.cc:302] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.432682 18410 raft_consensus.cc:2781] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.432718 18296 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.432760 18410 raft_consensus.cc:686] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.432852 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09a85049bcb54ab3997e07ab7f564c77" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.432893 18410 consensus_queue.cc:237] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.428323 18220 leader_election.cc:302] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5; no voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.432976 18101 raft_consensus.cc:2454] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.433696 18296 tablet_bootstrap.cc:654] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.433775 18220 leader_election.cc:302] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.434010 18351 raft_consensus.cc:3037] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.422554 18302 raft_consensus.cc:504] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.434578 18302 leader_election.cc:288] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.431823 18298 tablet_bootstrap.cc:654] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.434906 18351 raft_consensus.cc:2726] T 35e7e35b622f44e08a530601ac203994 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.435034 18351 raft_consensus.cc:2781] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.435128 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9327269d61b47f19172d4c209c710e7" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.435160 18351 raft_consensus.cc:482] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.435204 18351 raft_consensus.cc:3037] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.435240 18179 raft_consensus.cc:2379] T e9327269d61b47f19172d4c209c710e7 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7834062bf084f9cabbff4788a79d2a9 in current term 1: Already voted for candidate 030d4bb74d5046d98e41d25d74fce3f5 in this term.
I20240501 19:57:29.435521 18297 ts_tablet_manager.cc:1398] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20240501 19:57:29.435957 18351 raft_consensus.cc:504] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.436159 18000 catalog_manager.cc:5484] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.436252 18351 leader_election.cc:288] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.436297 18298 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.436362 18298 ts_tablet_manager.cc:1367] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20240501 19:57:29.436482 18067 leader_election.cc:302] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9; no voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.436698 18298 raft_consensus.cc:348] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.436791 18298 raft_consensus.cc:374] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.436823 18298 raft_consensus.cc:729] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.436910 18298 consensus_queue.cc:260] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.436934 18353 raft_consensus.cc:3037] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.437178 18298 ts_tablet_manager.cc:1398] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.437325 18298 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.437439 18297 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.437806 18353 raft_consensus.cc:2726] T e9327269d61b47f19172d4c209c710e7 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.434952 18296 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.438123 18296 ts_tablet_manager.cc:1367] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.438400 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d386ffed734860bb531b7b950da488" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.438464 18298 tablet_bootstrap.cc:654] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.438441 18297 tablet_bootstrap.cc:654] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.438527 18254 raft_consensus.cc:3037] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.438756 18296 raft_consensus.cc:348] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.438925 18296 raft_consensus.cc:374] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.438984 18296 raft_consensus.cc:729] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.439117 18296 consensus_queue.cc:260] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.439359 18254 raft_consensus.cc:2454] T 74d386ffed734860bb531b7b950da488 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.439436 18296 ts_tablet_manager.cc:1398] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.439595 18296 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.439736 18298 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.439821 18298 ts_tablet_manager.cc:1367] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.440104 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09a85049bcb54ab3997e07ab7f564c77" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.440192 18298 raft_consensus.cc:348] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.440307 18298 raft_consensus.cc:374] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.440341 18298 raft_consensus.cc:729] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.440351 18146 leader_election.cc:302] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.440515 18296 tablet_bootstrap.cc:654] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.440208 18101 raft_consensus.cc:3037] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.441299 18101 raft_consensus.cc:2454] T 09a85049bcb54ab3997e07ab7f564c77 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.440464 18298 consensus_queue.cc:260] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.441421 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d386ffed734860bb531b7b950da488" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.441540 18102 raft_consensus.cc:3037] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.441651 18298 ts_tablet_manager.cc:1398] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 19:57:29.441675 18296 tablet_bootstrap.cc:492] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.441732 18296 ts_tablet_manager.cc:1367] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.441812 18298 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.442010 18296 raft_consensus.cc:348] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.442083 18296 raft_consensus.cc:374] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.442102 18296 raft_consensus.cc:729] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.442194 18296 consensus_queue.cc:260] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.442365 18478 raft_consensus.cc:2781] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.442394 18102 raft_consensus.cc:2454] T 74d386ffed734860bb531b7b950da488 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.442447 18478 raft_consensus.cc:686] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.442472 18296 ts_tablet_manager.cc:1398] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.442605 18478 consensus_queue.cc:237] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.442754 18220 leader_election.cc:302] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.442788 18298 tablet_bootstrap.cc:654] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.442936 18331 raft_consensus.cc:2781] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.443080 18331 raft_consensus.cc:686] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.443220 18331 consensus_queue.cc:237] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.442610 18296 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.444068 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "09a85049bcb54ab3997e07ab7f564c77" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.444413 18296 tablet_bootstrap.cc:654] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
W20240501 19:57:29.444387 18218 leader_election.cc:341] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.445398 18297 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.445464 18296 tablet_bootstrap.cc:492] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.445539 18297 ts_tablet_manager.cc:1367] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20240501 19:57:29.445560 18296 ts_tablet_manager.cc:1367] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.445613 18000 catalog_manager.cc:5484] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.445928 18297 raft_consensus.cc:348] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.446010 18297 raft_consensus.cc:374] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.446095 18297 raft_consensus.cc:729] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.446003 17999 catalog_manager.cc:5484] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.446199 18297 consensus_queue.cc:260] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.446297 17999 catalog_manager.cc:5484] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.446492 18297 ts_tablet_manager.cc:1398] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.446029 18296 raft_consensus.cc:348] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.446616 18296 raft_consensus.cc:374] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.446651 18296 raft_consensus.cc:729] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.446697 18297 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.446756 18296 consensus_queue.cc:260] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.447028 18296 ts_tablet_manager.cc:1398] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.447196 18296 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.447557 18297 tablet_bootstrap.cc:654] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.448037 18296 tablet_bootstrap.cc:654] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.448673 18297 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.448767 18297 ts_tablet_manager.cc:1367] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.448824 18302 raft_consensus.cc:482] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.448913 18302 raft_consensus.cc:504] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.449246 18302 leader_election.cc:288] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.449263 18297 raft_consensus.cc:348] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.449388 18297 raft_consensus.cc:374] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.449432 18297 raft_consensus.cc:729] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.449601 18297 consensus_queue.cc:260] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.449661 18298 tablet_bootstrap.cc:492] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.449759 18298 ts_tablet_manager.cc:1367] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20240501 19:57:29.449926 18297 ts_tablet_manager.cc:1398] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.450093 18297 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.450150 18298 raft_consensus.cc:348] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.450255 18298 raft_consensus.cc:374] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.450309 18298 raft_consensus.cc:729] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.450443 18298 consensus_queue.cc:260] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.450769 18298 ts_tablet_manager.cc:1398] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.450934 18298 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.451005 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9ae0611714476599196cbc902d5f66" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.451092 18102 raft_consensus.cc:2454] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.451282 18302 raft_consensus.cc:482] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.451355 18302 raft_consensus.cc:504] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.451529 18351 raft_consensus.cc:482] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.451601 18351 raft_consensus.cc:504] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.451647 18302 leader_election.cc:288] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.451826 18298 tablet_bootstrap.cc:654] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.451918 18351 leader_election.cc:288] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.451963 18145 leader_election.cc:302] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.452291 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1b770b027404a81b4bc7a4080e3ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.452332 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1b770b027404a81b4bc7a4080e3ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.452399 18255 raft_consensus.cc:2454] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.452432 18102 raft_consensus.cc:2454] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.452512 18331 raft_consensus.cc:482] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.452581 18331 raft_consensus.cc:504] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.452666 18302 raft_consensus.cc:2781] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.452714 18302 raft_consensus.cc:482] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.452750 18302 raft_consensus.cc:3037] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.452844 18297 tablet_bootstrap.cc:654] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.452677 18146 leader_election.cc:302] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.452908 18331 leader_election.cc:288] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.449673 18296 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.453152 18296 ts_tablet_manager.cc:1367] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.453263 18331 raft_consensus.cc:482] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.453344 18331 raft_consensus.cc:504] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.453591 18296 raft_consensus.cc:348] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.453644 18302 raft_consensus.cc:504] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.453687 18296 raft_consensus.cc:374] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.453728 18296 raft_consensus.cc:729] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.453691 18331 leader_election.cc:288] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.453944 18302 leader_election.cc:288] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.454035 18302 raft_consensus.cc:2781] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.454079 18302 raft_consensus.cc:482] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.454123 18302 raft_consensus.cc:3037] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.454291 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88369b2534e44de0a090bd8eaa461755" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.454368 18179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba4c26eae1f4731982f3bb0485eace9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.454416 18104 raft_consensus.cc:2454] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.454459 18179 raft_consensus.cc:2454] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.454607 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.454639 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88369b2534e44de0a090bd8eaa461755" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.454670 18220 leader_election.cc:302] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.454748 18178 raft_consensus.cc:2454] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.454802 18331 raft_consensus.cc:2781] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.454836 18331 raft_consensus.cc:482] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.454882 18331 raft_consensus.cc:3037] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.453817 18296 consensus_queue.cc:260] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.455060 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9ae0611714476599196cbc902d5f66" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.455144 18296 ts_tablet_manager.cc:1398] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.455214 18102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba4c26eae1f4731982f3bb0485eace9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.455288 18102 raft_consensus.cc:2454] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.455322 18296 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.455530 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9ae0611714476599196cbc902d5f66" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.455636 18254 raft_consensus.cc:2454] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.455615 18220 leader_election.cc:302] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.455718 18331 raft_consensus.cc:504] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.455827 18351 raft_consensus.cc:2781] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.455878 18351 raft_consensus.cc:482] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.455924 18351 raft_consensus.cc:3037] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.456063 18331 leader_election.cc:288] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.456286 18296 tablet_bootstrap.cc:654] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
W20240501 19:57:29.456454 18218 leader_election.cc:341] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.456781 18298 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.454291 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.456858 18298 ts_tablet_manager.cc:1367] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:57:29.456914 18101 raft_consensus.cc:2454] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.455152 18104 raft_consensus.cc:3037] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.457083 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9ae0611714476599196cbc902d5f66" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.457159 18255 raft_consensus.cc:3037] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.457286 18298 raft_consensus.cc:348] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.457368 18298 raft_consensus.cc:374] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.457396 18298 raft_consensus.cc:729] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.457516 18298 consensus_queue.cc:260] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.457537 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88369b2534e44de0a090bd8eaa461755" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.457650 18178 raft_consensus.cc:3037] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.457796 18298 ts_tablet_manager.cc:1398] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.458010 18298 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.458251 18104 raft_consensus.cc:2454] T 7e9ae0611714476599196cbc902d5f66 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.458411 18178 raft_consensus.cc:2454] T 88369b2534e44de0a090bd8eaa461755 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.458496 18145 leader_election.cc:302] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.458411 18255 raft_consensus.cc:2454] T 7e9ae0611714476599196cbc902d5f66 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.458721 18478 raft_consensus.cc:2781] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.458815 18478 raft_consensus.cc:686] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.458963 18478 consensus_queue.cc:237] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.459173 18220 leader_election.cc:302] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.459220 18297 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.459314 18331 raft_consensus.cc:2781] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.456820 18351 raft_consensus.cc:504] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.459353 18297 ts_tablet_manager.cc:1367] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20240501 19:57:29.459374 18331 raft_consensus.cc:482] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.460184 18331 raft_consensus.cc:3037] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.454890 18302 raft_consensus.cc:504] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.460599 18297 raft_consensus.cc:348] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.460708 18297 raft_consensus.cc:374] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.460759 18302 leader_election.cc:288] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.460064 18351 leader_election.cc:288] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.460768 18297 raft_consensus.cc:729] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.460996 18331 raft_consensus.cc:504] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.459678 18218 leader_election.cc:302] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.461311 18331 leader_election.cc:288] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.461398 18331 raft_consensus.cc:2781] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.461439 18296 tablet_bootstrap.cc:492] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.461515 18331 raft_consensus.cc:686] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.461546 18296 ts_tablet_manager.cc:1367] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.461640 18331 consensus_queue.cc:237] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.461808 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1b770b027404a81b4bc7a4080e3ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.461879 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.461903 18101 raft_consensus.cc:3037] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.461925 18296 raft_consensus.cc:348] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.462021 18296 raft_consensus.cc:374] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.462056 18296 raft_consensus.cc:729] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.458969 18298 tablet_bootstrap.cc:654] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.459462 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88369b2534e44de0a090bd8eaa461755" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.462181 18296 consensus_queue.cc:260] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.462275 18104 raft_consensus.cc:3037] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.462463 18296 ts_tablet_manager.cc:1398] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.462608 18296 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.462750 18101 raft_consensus.cc:2454] T dfe1b770b027404a81b4bc7a4080e3ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.462982 18145 leader_election.cc:302] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.463030 18104 raft_consensus.cc:2454] T 88369b2534e44de0a090bd8eaa461755 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.463155 18478 raft_consensus.cc:2781] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.463224 18478 raft_consensus.cc:686] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.463332 18478 consensus_queue.cc:237] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.463505 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfe1b770b027404a81b4bc7a4080e3ae" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.463629 18255 raft_consensus.cc:3037] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.463675 18296 tablet_bootstrap.cc:654] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.463860 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba4c26eae1f4731982f3bb0485eace9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.463956 18178 raft_consensus.cc:3037] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.464419 18255 raft_consensus.cc:2454] T dfe1b770b027404a81b4bc7a4080e3ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.464525 18178 raft_consensus.cc:2454] T 1ba4c26eae1f4731982f3bb0485eace9 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.465085 18296 tablet_bootstrap.cc:492] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.465178 18296 ts_tablet_manager.cc:1367] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.465430 18353 raft_consensus.cc:482] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.465525 18353 raft_consensus.cc:504] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.465580 18296 raft_consensus.cc:348] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
W20240501 19:57:29.465631 18218 leader_election.cc:341] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.465745 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ba4c26eae1f4731982f3bb0485eace9" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.465765 18218 leader_election.cc:302] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.465827 18353 leader_election.cc:288] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.465906 18331 raft_consensus.cc:2781] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.465826 18104 raft_consensus.cc:3037] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.465984 18331 raft_consensus.cc:686] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.466027 17999 catalog_manager.cc:5484] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.466117 18331 consensus_queue.cc:237] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.466302 17999 catalog_manager.cc:5484] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.463514 18297 consensus_queue.cc:260] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.466914 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.467044 18255 raft_consensus.cc:2454] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.467227 18297 ts_tablet_manager.cc:1398] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20240501 19:57:29.467293 18070 leader_election.cc:302] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.467444 18353 raft_consensus.cc:2781] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.467509 18353 raft_consensus.cc:482] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.466782 18104 raft_consensus.cc:2454] T 1ba4c26eae1f4731982f3bb0485eace9 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.467535 18297 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.467569 18353 raft_consensus.cc:3037] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.466914 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
W20240501 19:57:29.468138 18067 leader_election.cc:341] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.468436 18296 raft_consensus.cc:374] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.468503 18296 raft_consensus.cc:729] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.468583 18353 raft_consensus.cc:504] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.468658 18296 consensus_queue.cc:260] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.468853 18297 tablet_bootstrap.cc:654] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.468901 18353 leader_election.cc:288] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.468959 18296 ts_tablet_manager.cc:1398] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240501 19:57:29.469162 18296 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.469269 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.469367 18255 raft_consensus.cc:3037] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.463610 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.470055 18101 raft_consensus.cc:3037] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.470163 18296 tablet_bootstrap.cc:654] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.470227 18255 raft_consensus.cc:2454] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.470717 18070 leader_election.cc:302] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.470880 18298 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.470901 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.470959 18298 ts_tablet_manager.cc:1367] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
W20240501 19:57:29.471199 18067 leader_election.cc:341] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.471323 18298 raft_consensus.cc:348] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.471406 18298 raft_consensus.cc:374] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.471436 18298 raft_consensus.cc:729] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.467581 18000 catalog_manager.cc:5484] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.471530 18298 consensus_queue.cc:260] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.471627 18296 tablet_bootstrap.cc:492] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.471699 18296 ts_tablet_manager.cc:1367] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.471812 18298 ts_tablet_manager.cc:1398] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.471923 18353 raft_consensus.cc:2781] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.471956 18298 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.472012 18353 raft_consensus.cc:686] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.472117 18353 consensus_queue.cc:237] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.472265 18296 raft_consensus.cc:348] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.472347 18296 raft_consensus.cc:374] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.472378 18296 raft_consensus.cc:729] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.472471 18296 consensus_queue.cc:260] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.472842 18298 tablet_bootstrap.cc:654] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.472959 18296 ts_tablet_manager.cc:1398] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.473131 18296 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.473223 18297 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.473289 18297 ts_tablet_manager.cc:1367] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:57:29.473752 18297 raft_consensus.cc:348] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.473848 18297 raft_consensus.cc:374] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.473881 18297 raft_consensus.cc:729] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.473989 18297 consensus_queue.cc:260] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.474092 18296 tablet_bootstrap.cc:654] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.474300 18297 ts_tablet_manager.cc:1398] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.470917 18101 raft_consensus.cc:2454] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.474581 18297 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.475088 18296 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.475172 18296 ts_tablet_manager.cc:1367] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.475297 18220 leader_election.cc:302] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.475526 18297 tablet_bootstrap.cc:654] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.475590 18296 raft_consensus.cc:348] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.475685 18296 raft_consensus.cc:374] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.475723 18296 raft_consensus.cc:729] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.475834 18296 consensus_queue.cc:260] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.476122 18296 ts_tablet_manager.cc:1398] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.476264 18296 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.476217 17999 catalog_manager.cc:5484] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.476709 18331 raft_consensus.cc:2781] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.476790 18331 raft_consensus.cc:686] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.476910 18331 consensus_queue.cc:237] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.477281 18296 tablet_bootstrap.cc:654] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.477453 18331 raft_consensus.cc:482] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.477713 18331 raft_consensus.cc:504] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.478005 18331 leader_election.cc:288] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.478333 18000 catalog_manager.cc:5484] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.478471 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc61f5a2be4433385c75108851784d7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.478472 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc61f5a2be4433385c75108851784d7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.478619 18101 raft_consensus.cc:2454] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.478652 18178 raft_consensus.cc:2454] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.478789 18298 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.478868 18298 ts_tablet_manager.cc:1367] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240501 19:57:29.478843 18220 leader_election.cc:302] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.479104 18331 raft_consensus.cc:2781] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.479154 18331 raft_consensus.cc:482] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.479200 18331 raft_consensus.cc:3037] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.479254 18298 raft_consensus.cc:348] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.479324 18298 raft_consensus.cc:374] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.479344 18298 raft_consensus.cc:729] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.479437 18298 consensus_queue.cc:260] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.479701 18298 ts_tablet_manager.cc:1398] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.479871 18298 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.480053 18331 raft_consensus.cc:504] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.480363 18331 leader_election.cc:288] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.480897 18298 tablet_bootstrap.cc:654] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.480894 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc61f5a2be4433385c75108851784d7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.481045 18178 raft_consensus.cc:3037] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.481995 18178 raft_consensus.cc:2454] T 6dc61f5a2be4433385c75108851784d7 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.482051 18296 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.482117 18296 ts_tablet_manager.cc:1367] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 19:57:29.482215 18218 leader_election.cc:302] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.482368 18331 raft_consensus.cc:2781] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.482439 18331 raft_consensus.cc:686] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.482450 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6dc61f5a2be4433385c75108851784d7" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.482542 18296 raft_consensus.cc:348] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.482654 18296 raft_consensus.cc:374] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.482559 18331 consensus_queue.cc:237] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.482685 18296 raft_consensus.cc:729] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.482786 18296 consensus_queue.cc:260] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.482537 18101 raft_consensus.cc:3037] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.483064 18296 ts_tablet_manager.cc:1398] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.483175 18297 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.483239 18296 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.483266 18297 ts_tablet_manager.cc:1367] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240501 19:57:29.483587 18297 raft_consensus.cc:348] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.483669 18297 raft_consensus.cc:374] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.483704 18297 raft_consensus.cc:729] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.483773 18101 raft_consensus.cc:2454] T 6dc61f5a2be4433385c75108851784d7 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.483826 18297 consensus_queue.cc:260] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.484140 18297 ts_tablet_manager.cc:1398] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.484148 18296 tablet_bootstrap.cc:654] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.484333 18297 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9: Bootstrap starting.
I20240501 19:57:29.485260 18297 tablet_bootstrap.cc:654] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.486358 18297 tablet_bootstrap.cc:492] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9: No bootstrap required, opened a new log
I20240501 19:57:29.486443 18297 ts_tablet_manager.cc:1367] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240501 19:57:29.486769 18297 raft_consensus.cc:348] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.486860 18297 raft_consensus.cc:374] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.486896 18297 raft_consensus.cc:729] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.487037 18297 consensus_queue.cc:260] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.487349 18297 ts_tablet_manager.cc:1398] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240501 19:57:29.487560 17998 catalog_manager.cc:5484] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.487813 17998 catalog_manager.cc:5484] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.488590 18298 tablet_bootstrap.cc:492] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.488668 18298 ts_tablet_manager.cc:1367] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20240501 19:57:29.488708 18296 tablet_bootstrap.cc:492] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.488780 18296 ts_tablet_manager.cc:1367] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:57:29.489043 18298 raft_consensus.cc:348] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.489138 18298 raft_consensus.cc:374] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.489171 18298 raft_consensus.cc:729] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.489223 18296 raft_consensus.cc:348] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.489312 18296 raft_consensus.cc:374] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.489346 18296 raft_consensus.cc:729] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.489354 18298 consensus_queue.cc:260] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.489451 18296 consensus_queue.cc:260] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.489670 18298 ts_tablet_manager.cc:1398] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.489729 18296 ts_tablet_manager.cc:1398] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.489820 18298 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.489881 18296 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.490679 18298 tablet_bootstrap.cc:654] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.490811 18296 tablet_bootstrap.cc:654] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.491247 18351 raft_consensus.cc:482] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.491325 18351 raft_consensus.cc:504] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.491660 18351 leader_election.cc:288] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.492089 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.492125 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.492229 18101 raft_consensus.cc:2454] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
W20240501 19:57:29.492390 18218 leader_election.cc:341] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.492489 18220 leader_election.cc:302] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.492694 18296 tablet_bootstrap.cc:492] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.492720 18351 raft_consensus.cc:2781] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.492770 18351 raft_consensus.cc:482] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.492790 18296 ts_tablet_manager.cc:1367] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.492806 18351 raft_consensus.cc:3037] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.492962 18298 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.493029 18298 ts_tablet_manager.cc:1367] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.493224 18296 raft_consensus.cc:348] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.493331 18296 raft_consensus.cc:374] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.493367 18296 raft_consensus.cc:729] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.493448 18298 raft_consensus.cc:348] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.493494 18296 consensus_queue.cc:260] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.493774 18296 ts_tablet_manager.cc:1398] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.493750 18351 raft_consensus.cc:504] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.493955 18296 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.494102 18351 leader_election.cc:288] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.494488 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.494845 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.494931 18101 raft_consensus.cc:3037] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
W20240501 19:57:29.494956 18218 leader_election.cc:341] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): Illegal state: must be running to vote when last-logged opid is not known
I20240501 19:57:29.495075 18296 tablet_bootstrap.cc:654] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.495573 18298 raft_consensus.cc:374] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.495622 18298 raft_consensus.cc:729] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.495743 18101 raft_consensus.cc:2454] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.495760 18298 consensus_queue.cc:260] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.496026 18220 leader_election.cc:302] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.496058 18298 ts_tablet_manager.cc:1398] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 19:57:29.496263 18351 raft_consensus.cc:2781] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.496348 18298 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.496343 18351 raft_consensus.cc:686] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.496518 18351 consensus_queue.cc:237] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.496785 18296 tablet_bootstrap.cc:492] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.496861 18296 ts_tablet_manager.cc:1367] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:29.497274 18298 tablet_bootstrap.cc:654] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.497288 18296 raft_consensus.cc:348] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.497538 18296 raft_consensus.cc:374] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.497586 18296 raft_consensus.cc:729] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.497735 18296 consensus_queue.cc:260] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.498057 18296 ts_tablet_manager.cc:1398] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.498265 18296 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.498282 18351 raft_consensus.cc:482] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.498358 18351 raft_consensus.cc:504] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.498642 18351 leader_election.cc:288] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.499043 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d193261354994d2db384d9db69a5b463" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.499152 18101 raft_consensus.cc:2454] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.499176 18296 tablet_bootstrap.cc:654] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.499389 18220 leader_election.cc:302] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.499600 18351 raft_consensus.cc:2781] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.499699 18351 raft_consensus.cc:482] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.499626 17998 catalog_manager.cc:5484] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.499752 18298 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.499768 18351 raft_consensus.cc:3037] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.499828 18298 ts_tablet_manager.cc:1367] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240501 19:57:29.500224 18298 raft_consensus.cc:348] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.500322 18298 raft_consensus.cc:374] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.500355 18298 raft_consensus.cc:729] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.500454 18351 raft_consensus.cc:504] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.500476 18298 consensus_queue.cc:260] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.500802 18298 ts_tablet_manager.cc:1398] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.500871 18351 leader_election.cc:288] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.500960 18298 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5: Bootstrap starting.
I20240501 19:57:29.501029 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d193261354994d2db384d9db69a5b463" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.501132 18101 raft_consensus.cc:3037] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.501451 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d193261354994d2db384d9db69a5b463" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.501556 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d193261354994d2db384d9db69a5b463" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.501574 18178 raft_consensus.cc:2454] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.502034 18298 tablet_bootstrap.cc:654] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.502029 18101 raft_consensus.cc:2454] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.502362 18220 leader_election.cc:302] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters: d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.502633 18351 raft_consensus.cc:2781] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.502720 18351 raft_consensus.cc:686] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.502848 18351 consensus_queue.cc:237] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.504498 18296 tablet_bootstrap.cc:492] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.504604 18296 ts_tablet_manager.cc:1367] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240501 19:57:29.505052 18296 raft_consensus.cc:348] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.504987 17999 catalog_manager.cc:5484] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.505142 18296 raft_consensus.cc:374] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.505174 18296 raft_consensus.cc:729] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.505307 18296 consensus_queue.cc:260] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.505666 18296 ts_tablet_manager.cc:1398] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.505939 18296 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.506170 18298 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5: No bootstrap required, opened a new log
I20240501 19:57:29.506238 18298 ts_tablet_manager.cc:1367] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240501 19:57:29.506623 18298 raft_consensus.cc:348] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.506716 18298 raft_consensus.cc:374] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.506762 18298 raft_consensus.cc:729] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.506831 18296 tablet_bootstrap.cc:654] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.506880 18298 consensus_queue.cc:260] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.507164 18298 ts_tablet_manager.cc:1398] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.507875 18296 tablet_bootstrap.cc:492] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.507973 18296 ts_tablet_manager.cc:1367] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.508383 18296 raft_consensus.cc:348] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.508476 18296 raft_consensus.cc:374] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.508533 18296 raft_consensus.cc:729] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.508652 18296 consensus_queue.cc:260] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.508927 18296 ts_tablet_manager.cc:1398] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.509104 18296 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.509934 18296 tablet_bootstrap.cc:654] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.510851 18296 tablet_bootstrap.cc:492] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.510932 18296 ts_tablet_manager.cc:1367] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.511246 18296 raft_consensus.cc:348] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.511334 18296 raft_consensus.cc:374] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.511370 18296 raft_consensus.cc:729] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.511504 18296 consensus_queue.cc:260] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.511783 18296 ts_tablet_manager.cc:1398] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.512017 18296 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.512774 18296 tablet_bootstrap.cc:654] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.513892 18296 tablet_bootstrap.cc:492] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.513965 18296 ts_tablet_manager.cc:1367] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240501 19:57:29.514297 18296 raft_consensus.cc:348] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.514374 18296 raft_consensus.cc:374] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.514394 18296 raft_consensus.cc:729] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.514487 18296 consensus_queue.cc:260] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.514796 18296 ts_tablet_manager.cc:1398] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.514978 18296 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.515758 18296 tablet_bootstrap.cc:654] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.515898 18351 raft_consensus.cc:482] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.515990 18351 raft_consensus.cc:504] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.516345 18351 leader_election.cc:288] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.516724 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7844cb8be7435ebb038b6340f6b27a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.516773 18296 tablet_bootstrap.cc:492] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.516872 18296 ts_tablet_manager.cc:1367] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.516906 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7844cb8be7435ebb038b6340f6b27a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.516855 18178 raft_consensus.cc:2454] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.517014 18101 raft_consensus.cc:2454] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.517275 18220 leader_election.cc:302] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.517287 18296 raft_consensus.cc:348] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.517607 18296 raft_consensus.cc:374] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.517648 18296 raft_consensus.cc:729] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.517712 18331 raft_consensus.cc:2781] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.517763 18331 raft_consensus.cc:482] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.517750 18296 consensus_queue.cc:260] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.517799 18331 raft_consensus.cc:3037] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.518004 18296 ts_tablet_manager.cc:1398] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.518124 18296 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.518723 18331 raft_consensus.cc:504] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.519016 18296 tablet_bootstrap.cc:654] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.519047 18331 leader_election.cc:288] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.519140 18331 consensus_queue.cc:1035] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.519307 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7844cb8be7435ebb038b6340f6b27a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.519398 18178 raft_consensus.cc:3037] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.519946 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc7844cb8be7435ebb038b6340f6b27a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.520058 18101 raft_consensus.cc:3037] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.520555 18178 raft_consensus.cc:2454] T bc7844cb8be7435ebb038b6340f6b27a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.520831 18218 leader_election.cc:302] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.520889 18101 raft_consensus.cc:2454] T bc7844cb8be7435ebb038b6340f6b27a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.520979 18351 raft_consensus.cc:2781] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.521063 18351 raft_consensus.cc:686] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.521191 18351 consensus_queue.cc:237] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.522600 18296 tablet_bootstrap.cc:492] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.522686 18296 ts_tablet_manager.cc:1367] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240501 19:57:29.522881 17999 catalog_manager.cc:5484] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.523102 18296 raft_consensus.cc:348] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.523190 18296 raft_consensus.cc:374] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.523221 18296 raft_consensus.cc:729] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.523313 18296 consensus_queue.cc:260] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.523577 18296 ts_tablet_manager.cc:1398] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:29.523677 18331 consensus_queue.cc:1035] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.523763 18296 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04: Bootstrap starting.
I20240501 19:57:29.524688 18296 tablet_bootstrap.cc:654] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04: Neither blocks nor log segments found. Creating new log.
I20240501 19:57:29.525552 18478 raft_consensus.cc:482] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.525633 18478 raft_consensus.cc:504] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.525972 18296 tablet_bootstrap.cc:492] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04: No bootstrap required, opened a new log
I20240501 19:57:29.526041 18478 leader_election.cc:288] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.526157 18296 ts_tablet_manager.cc:1367] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240501 19:57:29.526325 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd26327aee2e4181baeab9dd52e5fa02" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.526436 18353 raft_consensus.cc:482] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.526522 18353 raft_consensus.cc:504] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.526568 18296 raft_consensus.cc:348] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.526635 18296 raft_consensus.cc:374] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 19:57:29.526664 18296 raft_consensus.cc:729] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Initialized, Role: FOLLOWER
I20240501 19:57:29.526804 18296 consensus_queue.cc:260] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.526857 18353 leader_election.cc:288] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.526979 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd26327aee2e4181baeab9dd52e5fa02" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.526451 18255 raft_consensus.cc:2454] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.527078 18104 raft_consensus.cc:2454] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.527307 18146 leader_election.cc:302] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.527618 18302 raft_consensus.cc:2781] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.527683 18302 raft_consensus.cc:482] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.527730 18302 raft_consensus.cc:3037] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.527084 18296 ts_tablet_manager.cc:1398] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.528105 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.528237 18255 raft_consensus.cc:2379] T 71582136edac4d888b956930282063b2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a7834062bf084f9cabbff4788a79d2a9 in current term 1: Already voted for candidate d7ebf87da4c94e46a875293608ddad04 in this term.
I20240501 19:57:29.528448 18302 raft_consensus.cc:504] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.528755 18302 leader_election.cc:288] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.528911 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71582136edac4d888b956930282063b2" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.528995 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd26327aee2e4181baeab9dd52e5fa02" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.529106 18104 raft_consensus.cc:3037] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.529275 18067 leader_election.cc:302] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9; no voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04
I20240501 19:57:29.529385 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd26327aee2e4181baeab9dd52e5fa02" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.529489 18255 raft_consensus.cc:3037] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.529536 18353 raft_consensus.cc:3037] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.529990 18104 raft_consensus.cc:2454] T fd26327aee2e4181baeab9dd52e5fa02 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.530194 18255 raft_consensus.cc:2454] T fd26327aee2e4181baeab9dd52e5fa02 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.530284 18145 leader_election.cc:302] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.530375 18353 raft_consensus.cc:2726] T 71582136edac4d888b956930282063b2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.530427 18478 raft_consensus.cc:2781] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.530571 18478 raft_consensus.cc:686] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.530705 18478 consensus_queue.cc:237] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.532629 17999 catalog_manager.cc:5484] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.543112 18331 raft_consensus.cc:482] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.543215 18331 raft_consensus.cc:504] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.543588 18331 leader_election.cc:288] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.543928 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1712a8811770442ebe9a94ac36f23362" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.543938 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1712a8811770442ebe9a94ac36f23362" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.544066 18178 raft_consensus.cc:2454] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.544072 18104 raft_consensus.cc:2454] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.544337 18218 leader_election.cc:302] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.544492 18331 raft_consensus.cc:2781] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.544559 18331 raft_consensus.cc:482] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.544586 18331 raft_consensus.cc:3037] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.544728 18353 raft_consensus.cc:482] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.544811 18353 raft_consensus.cc:504] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.545120 18353 leader_election.cc:288] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.545362 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0329a5653d944689bd539e54b2531c32" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.545378 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0329a5653d944689bd539e54b2531c32" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.545521 18255 raft_consensus.cc:2454] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.545547 18178 raft_consensus.cc:2454] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.545626 18331 raft_consensus.cc:504] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.545800 18070 leader_election.cc:302] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.545949 18331 leader_election.cc:288] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.545984 18353 raft_consensus.cc:2781] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.546037 18353 raft_consensus.cc:482] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.546080 18353 raft_consensus.cc:3037] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.546250 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1712a8811770442ebe9a94ac36f23362" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.546247 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1712a8811770442ebe9a94ac36f23362" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.546352 18104 raft_consensus.cc:3037] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.546363 18178 raft_consensus.cc:3037] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.546948 18353 raft_consensus.cc:504] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.547012 18178 raft_consensus.cc:2454] T 1712a8811770442ebe9a94ac36f23362 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.547188 18104 raft_consensus.cc:2454] T 1712a8811770442ebe9a94ac36f23362 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.547286 18218 leader_election.cc:302] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.547348 18353 leader_election.cc:288] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.547449 18331 raft_consensus.cc:2781] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.547547 18331 raft_consensus.cc:686] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.547681 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0329a5653d944689bd539e54b2531c32" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.547681 18331 consensus_queue.cc:237] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.547808 18255 raft_consensus.cc:3037] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.547808 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0329a5653d944689bd539e54b2531c32" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.547988 18178 raft_consensus.cc:3037] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.548671 18178 raft_consensus.cc:2454] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.548671 18255 raft_consensus.cc:2454] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.548949 18067 leader_election.cc:302] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.549113 18353 raft_consensus.cc:2781] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.549217 18353 raft_consensus.cc:686] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.549348 18353 consensus_queue.cc:237] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.549937 17999 catalog_manager.cc:5484] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.551340 17998 catalog_manager.cc:5484] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.551445 18353 raft_consensus.cc:482] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.551528 18353 raft_consensus.cc:504] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.552249 18353 leader_election.cc:288] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.552505 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9e0f2e994d247ff90b3bf5f2f124e35" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.552567 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9e0f2e994d247ff90b3bf5f2f124e35" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.552613 18178 raft_consensus.cc:2454] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.552673 18255 raft_consensus.cc:2454] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.552891 18067 leader_election.cc:302] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.553107 18353 raft_consensus.cc:2781] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.553157 18353 raft_consensus.cc:482] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.553206 18353 raft_consensus.cc:3037] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.553938 18353 raft_consensus.cc:504] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.554236 18353 leader_election.cc:288] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.554474 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9e0f2e994d247ff90b3bf5f2f124e35" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.554512 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9e0f2e994d247ff90b3bf5f2f124e35" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.554600 18178 raft_consensus.cc:3037] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.554605 18255 raft_consensus.cc:3037] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.555189 18178 raft_consensus.cc:2454] T d9e0f2e994d247ff90b3bf5f2f124e35 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.555194 18255 raft_consensus.cc:2454] T d9e0f2e994d247ff90b3bf5f2f124e35 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.555471 18067 leader_election.cc:302] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.555619 18353 raft_consensus.cc:2781] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.555706 18353 raft_consensus.cc:686] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.555838 18353 consensus_queue.cc:237] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.557605 17998 catalog_manager.cc:5484] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.572672 18478 consensus_queue.cc:1035] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.575280 18410 consensus_queue.cc:1035] T 71582136edac4d888b956930282063b2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.585378 18410 raft_consensus.cc:482] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.585465 18410 raft_consensus.cc:504] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.585829 18410 leader_election.cc:288] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.586112 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.586134 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae0b1e22eede490e983dd3fe8e3ae9f5" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.586262 18104 raft_consensus.cc:2379] T ae0b1e22eede490e983dd3fe8e3ae9f5 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ebf87da4c94e46a875293608ddad04 in current term 1: Already voted for candidate 030d4bb74d5046d98e41d25d74fce3f5 in this term.
I20240501 19:57:29.586570 18145 leader_election.cc:302] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.586725 18410 raft_consensus.cc:3037] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.587498 18410 raft_consensus.cc:2726] T ae0b1e22eede490e983dd3fe8e3ae9f5 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.588387 18353 raft_consensus.cc:482] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.588466 18353 raft_consensus.cc:504] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.588794 18353 leader_election.cc:288] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.589074 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478eb3c7c83d4d9a9f329163435d8389" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.589093 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478eb3c7c83d4d9a9f329163435d8389" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.589167 18178 raft_consensus.cc:2454] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.589203 18255 raft_consensus.cc:2454] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.589411 18067 leader_election.cc:302] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.589581 18353 raft_consensus.cc:2781] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.589638 18353 raft_consensus.cc:482] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.589684 18353 raft_consensus.cc:3037] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.590333 18353 raft_consensus.cc:504] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.590641 18353 leader_election.cc:288] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.590901 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478eb3c7c83d4d9a9f329163435d8389" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.590905 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "478eb3c7c83d4d9a9f329163435d8389" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.591006 18178 raft_consensus.cc:3037] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.591027 18255 raft_consensus.cc:3037] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.591584 18178 raft_consensus.cc:2454] T 478eb3c7c83d4d9a9f329163435d8389 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.591807 18255 raft_consensus.cc:2454] T 478eb3c7c83d4d9a9f329163435d8389 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.591912 18067 leader_election.cc:302] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.592087 18353 raft_consensus.cc:2781] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.592164 18353 raft_consensus.cc:686] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.592299 18353 consensus_queue.cc:237] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.593847 18331 raft_consensus.cc:482] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.593935 18331 raft_consensus.cc:504] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.594305 18331 leader_election.cc:288] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.594318 17999 catalog_manager.cc:5484] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.594555 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbeb1209494eaf9b58c3f5452d3549" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.594595 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbeb1209494eaf9b58c3f5452d3549" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.594672 18104 raft_consensus.cc:2454] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.594687 18178 raft_consensus.cc:2454] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.594942 18218 leader_election.cc:302] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.595103 18331 raft_consensus.cc:2781] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.595150 18331 raft_consensus.cc:482] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.595185 18331 raft_consensus.cc:3037] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.595805 18353 raft_consensus.cc:482] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.595901 18353 raft_consensus.cc:504] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.595944 18331 raft_consensus.cc:504] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.596243 18331 leader_election.cc:288] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.596583 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426ee194254489c8be8b188642f20c4" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.596576 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbeb1209494eaf9b58c3f5452d3549" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.596699 18255 raft_consensus.cc:2454] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.596719 18178 raft_consensus.cc:3037] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.596774 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dfdbeb1209494eaf9b58c3f5452d3549" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.596863 18104 raft_consensus.cc:3037] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.596954 18070 leader_election.cc:302] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.597118 18305 raft_consensus.cc:2781] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.597193 18305 raft_consensus.cc:482] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.597240 18305 raft_consensus.cc:3037] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.597420 18178 raft_consensus.cc:2454] T dfdbeb1209494eaf9b58c3f5452d3549 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.596576 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426ee194254489c8be8b188642f20c4" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.597684 18180 raft_consensus.cc:2454] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.597841 18104 raft_consensus.cc:2454] T dfdbeb1209494eaf9b58c3f5452d3549 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.598053 18218 leader_election.cc:302] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.598174 18305 raft_consensus.cc:504] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.596257 18353 leader_election.cc:288] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.598485 18305 leader_election.cc:288] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.598603 18331 raft_consensus.cc:2781] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.598686 18331 raft_consensus.cc:686] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.598739 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426ee194254489c8be8b188642f20c4" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.598827 18255 raft_consensus.cc:3037] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.598812 18331 consensus_queue.cc:237] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.599622 18255 raft_consensus.cc:2454] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.599874 18070 leader_election.cc:302] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.599915 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c426ee194254489c8be8b188642f20c4" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.600018 18180 raft_consensus.cc:3037] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.600044 18305 raft_consensus.cc:2781] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.600160 18305 raft_consensus.cc:686] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.600282 18305 consensus_queue.cc:237] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.600673 18353 raft_consensus.cc:482] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.600788 18180 raft_consensus.cc:2454] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.600760 18353 raft_consensus.cc:504] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.601848 18353 leader_election.cc:288] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.602012 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00f74f62f4d43888bfd5ac0dbdacd8a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.602015 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00f74f62f4d43888bfd5ac0dbdacd8a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.602116 18180 raft_consensus.cc:2454] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.602188 18255 raft_consensus.cc:2454] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.602136 17999 catalog_manager.cc:5484] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.602452 18070 leader_election.cc:302] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.602365 17998 catalog_manager.cc:5484] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.602670 18353 raft_consensus.cc:2781] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.602720 18353 raft_consensus.cc:482] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.602749 18353 raft_consensus.cc:3037] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.603526 18353 raft_consensus.cc:504] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.603863 18353 leader_election.cc:288] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.604188 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00f74f62f4d43888bfd5ac0dbdacd8a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.604306 18255 raft_consensus.cc:3037] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.604611 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d00f74f62f4d43888bfd5ac0dbdacd8a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.604707 18180 raft_consensus.cc:3037] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.605062 18255 raft_consensus.cc:2454] T d00f74f62f4d43888bfd5ac0dbdacd8a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.605338 18070 leader_election.cc:302] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.605377 18180 raft_consensus.cc:2454] T d00f74f62f4d43888bfd5ac0dbdacd8a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.605495 18353 raft_consensus.cc:2781] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.605587 18353 raft_consensus.cc:686] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.605707 18353 consensus_queue.cc:237] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.606441 18351 raft_consensus.cc:482] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.606506 18351 raft_consensus.cc:504] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.606752 18351 leader_election.cc:288] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.606941 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590f797b1246400988d4177b27acd261" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.607041 18104 raft_consensus.cc:2454] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.607256 18220 leader_election.cc:302] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.607295 17998 catalog_manager.cc:5484] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.607407 18351 raft_consensus.cc:2781] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.607461 18351 raft_consensus.cc:482] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.607509 18351 raft_consensus.cc:3037] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.608021 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590f797b1246400988d4177b27acd261" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.608144 18180 raft_consensus.cc:2454] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.608230 18351 raft_consensus.cc:504] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.608546 18351 leader_election.cc:288] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.608805 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590f797b1246400988d4177b27acd261" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.608805 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "590f797b1246400988d4177b27acd261" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.608938 18104 raft_consensus.cc:3037] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.608938 18180 raft_consensus.cc:3037] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.609737 18180 raft_consensus.cc:2454] T 590f797b1246400988d4177b27acd261 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.609737 18104 raft_consensus.cc:2454] T 590f797b1246400988d4177b27acd261 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.609995 18218 leader_election.cc:302] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.610174 18351 raft_consensus.cc:2781] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.610265 18351 raft_consensus.cc:686] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.610388 18351 consensus_queue.cc:237] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.612083 17998 catalog_manager.cc:5484] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.612993 18331 raft_consensus.cc:482] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.613111 18331 raft_consensus.cc:504] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.613374 18331 leader_election.cc:288] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.613766 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae71a6ccffe4c1f908ccae0efba2841" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.613842 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae71a6ccffe4c1f908ccae0efba2841" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.613883 18104 raft_consensus.cc:2454] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.613947 18180 raft_consensus.cc:2454] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.614152 18220 leader_election.cc:302] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.614327 18331 raft_consensus.cc:2781] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.614372 18331 raft_consensus.cc:482] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.614420 18331 raft_consensus.cc:3037] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.615039 18331 raft_consensus.cc:504] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.615335 18331 leader_election.cc:288] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.615592 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae71a6ccffe4c1f908ccae0efba2841" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.615677 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ae71a6ccffe4c1f908ccae0efba2841" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.615767 18180 raft_consensus.cc:3037] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.615767 18104 raft_consensus.cc:3037] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.616045 18410 consensus_queue.cc:1035] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.616590 18180 raft_consensus.cc:2454] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.616708 18104 raft_consensus.cc:2454] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.616878 18218 leader_election.cc:302] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.617084 18331 raft_consensus.cc:2781] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.617180 18331 raft_consensus.cc:686] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.617307 18331 consensus_queue.cc:237] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.618924 18480 consensus_queue.cc:1035] T 2749600d09ea4d459be9f981c5f082db P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.620096 17999 catalog_manager.cc:5484] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.621631 18353 raft_consensus.cc:482] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.621722 18353 raft_consensus.cc:504] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.622045 18353 leader_election.cc:288] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.622231 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0cdf9414db4baa9427c85c30d79e0a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.622326 18178 raft_consensus.cc:2454] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.622581 18067 leader_election.cc:302] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.622715 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0cdf9414db4baa9427c85c30d79e0a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.622830 18255 raft_consensus.cc:2454] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.622887 18353 raft_consensus.cc:2781] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.622967 18353 raft_consensus.cc:482] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.623034 18353 raft_consensus.cc:3037] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.623447 18331 consensus_queue.cc:1035] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.623929 18353 raft_consensus.cc:504] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.624275 18353 leader_election.cc:288] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.624538 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0cdf9414db4baa9427c85c30d79e0a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.624639 18255 raft_consensus.cc:3037] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.625125 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c0cdf9414db4baa9427c85c30d79e0a" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.625232 18180 raft_consensus.cc:3037] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.625451 18255 raft_consensus.cc:2454] T 1c0cdf9414db4baa9427c85c30d79e0a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.625761 18070 leader_election.cc:302] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.625911 18353 raft_consensus.cc:2781] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.626000 18353 raft_consensus.cc:686] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.626109 18180 raft_consensus.cc:2454] T 1c0cdf9414db4baa9427c85c30d79e0a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.626152 18353 consensus_queue.cc:237] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.628269 17998 catalog_manager.cc:5484] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.628866 18551 consensus_queue.cc:1035] T e9327269d61b47f19172d4c209c710e7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.631906 18480 raft_consensus.cc:482] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.632006 18480 raft_consensus.cc:504] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.632381 18480 leader_election.cc:288] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.632563 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818d68581b324da38ffec03581cb3c12" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.632623 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818d68581b324da38ffec03581cb3c12" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.632678 18104 raft_consensus.cc:2454] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.632707 18255 raft_consensus.cc:2454] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.632902 18145 leader_election.cc:302] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.633090 18480 raft_consensus.cc:2781] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.633142 18480 raft_consensus.cc:482] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.633184 18480 raft_consensus.cc:3037] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.633952 18480 raft_consensus.cc:504] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.634306 18480 leader_election.cc:288] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.634564 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818d68581b324da38ffec03581cb3c12" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.634600 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818d68581b324da38ffec03581cb3c12" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.634687 18104 raft_consensus.cc:3037] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.634687 18255 raft_consensus.cc:3037] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.635514 18255 raft_consensus.cc:2454] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.635522 18104 raft_consensus.cc:2454] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.635704 18480 raft_consensus.cc:482] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.635793 18480 raft_consensus.cc:504] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.635818 18146 leader_election.cc:302] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.636070 18478 raft_consensus.cc:2781] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.636168 18478 raft_consensus.cc:686] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.636322 18478 consensus_queue.cc:237] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.636384 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3276a6a9232549b5bdc1a82b2ebaefc2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.636385 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3276a6a9232549b5bdc1a82b2ebaefc2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.636512 18104 raft_consensus.cc:2454] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.636538 18255 raft_consensus.cc:2454] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.636767 18145 leader_election.cc:302] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.636168 18480 leader_election.cc:288] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.636986 18302 raft_consensus.cc:2781] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.637145 18302 raft_consensus.cc:482] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.637176 18302 raft_consensus.cc:3037] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.637943 18302 raft_consensus.cc:504] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.638269 18302 leader_election.cc:288] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.638401 17999 catalog_manager.cc:5484] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.638599 18302 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.638947 18104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3276a6a9232549b5bdc1a82b2ebaefc2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.639030 18104 raft_consensus.cc:3037] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.639786 18104 raft_consensus.cc:2454] T 3276a6a9232549b5bdc1a82b2ebaefc2 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.639796 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3276a6a9232549b5bdc1a82b2ebaefc2" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.639901 18255 raft_consensus.cc:3037] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.640060 18145 leader_election.cc:302] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.640369 18302 raft_consensus.cc:482] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.640439 18302 raft_consensus.cc:504] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.640705 18255 raft_consensus.cc:2454] T 3276a6a9232549b5bdc1a82b2ebaefc2 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.640786 18302 leader_election.cc:288] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.640862 18302 raft_consensus.cc:2781] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.640933 18302 raft_consensus.cc:686] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.641078 18302 consensus_queue.cc:237] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.641461 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.642104 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ffbfd18ef4fc4fe393e9915ad65c69cf" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.642230 18101 raft_consensus.cc:2379] T ffbfd18ef4fc4fe393e9915ad65c69cf P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ebf87da4c94e46a875293608ddad04 in current term 1: Already voted for candidate 030d4bb74d5046d98e41d25d74fce3f5 in this term.
I20240501 19:57:29.642585 18145 leader_election.cc:302] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.642724 18480 raft_consensus.cc:3037] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.643518 18480 raft_consensus.cc:2726] T ffbfd18ef4fc4fe393e9915ad65c69cf P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.643389 17999 catalog_manager.cc:5484] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.643828 18302 raft_consensus.cc:482] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.643940 18302 raft_consensus.cc:504] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.644039 18478 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.644369 18302 leader_election.cc:288] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.644820 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b73caad778849b0b6c7cb625d4f0f24" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.644984 18254 raft_consensus.cc:2454] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.644847 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b73caad778849b0b6c7cb625d4f0f24" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.645155 18101 raft_consensus.cc:2454] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 0.
I20240501 19:57:29.645361 18146 leader_election.cc:302] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.645646 18302 raft_consensus.cc:2781] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.645732 18302 raft_consensus.cc:482] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.645785 18302 raft_consensus.cc:3037] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.646718 18302 raft_consensus.cc:504] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.647117 18302 leader_election.cc:288] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.647486 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b73caad778849b0b6c7cb625d4f0f24" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.647593 18254 raft_consensus.cc:3037] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.647846 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b73caad778849b0b6c7cb625d4f0f24" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.647935 18101 raft_consensus.cc:3037] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.648391 18254 raft_consensus.cc:2454] T 2b73caad778849b0b6c7cb625d4f0f24 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.648730 18146 leader_election.cc:302] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.648763 18101 raft_consensus.cc:2454] T 2b73caad778849b0b6c7cb625d4f0f24 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7ebf87da4c94e46a875293608ddad04 in term 1.
I20240501 19:57:29.648874 18302 raft_consensus.cc:2781] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.648952 18302 raft_consensus.cc:686] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Becoming Leader. State: Replica: d7ebf87da4c94e46a875293608ddad04, State: Running, Role: LEADER
I20240501 19:57:29.649078 18302 consensus_queue.cc:237] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.650636 18000 catalog_manager.cc:5484] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7ebf87da4c94e46a875293608ddad04 (127.16.155.2). New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.655550 18551 raft_consensus.cc:482] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.655637 18551 raft_consensus.cc:504] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.655918 18551 leader_election.cc:288] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.656167 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b98df59ebac64a7b8d40f0b227cdf42a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.656215 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b98df59ebac64a7b8d40f0b227cdf42a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.656275 18101 raft_consensus.cc:2454] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.656343 18180 raft_consensus.cc:2454] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.656513 18220 leader_election.cc:302] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.656664 18551 raft_consensus.cc:2781] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.656720 18551 raft_consensus.cc:482] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.656754 18551 raft_consensus.cc:3037] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.657523 18551 raft_consensus.cc:504] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.657871 18551 leader_election.cc:288] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.658248 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b98df59ebac64a7b8d40f0b227cdf42a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.658356 18180 raft_consensus.cc:3037] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.658620 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b98df59ebac64a7b8d40f0b227cdf42a" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.658712 18101 raft_consensus.cc:3037] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.658977 18180 raft_consensus.cc:2454] T b98df59ebac64a7b8d40f0b227cdf42a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.659229 18218 leader_election.cc:302] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.659319 18101 raft_consensus.cc:2454] T b98df59ebac64a7b8d40f0b227cdf42a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.659369 18551 raft_consensus.cc:2781] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.659468 18551 raft_consensus.cc:686] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.659600 18551 consensus_queue.cc:237] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.661303 18000 catalog_manager.cc:5484] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.683427 18551 consensus_queue.cc:1035] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.684710 18305 consensus_queue.cc:1035] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.686158 18331 consensus_queue.cc:1035] T e462158d407e44278078992c7b4f6a43 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.687718 18354 consensus_queue.cc:1035] T 76652359a5e4493c8b8b6af23cf4c834 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.693338 18178 raft_consensus.cc:3037] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.694517 18354 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.696753 18354 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.702483 18480 raft_consensus.cc:482] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.702574 18480 raft_consensus.cc:504] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.702919 18480 leader_election.cc:288] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.703107 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.703181 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2019ede82614cedb5655ccbaf31cb8b" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.703290 18254 raft_consensus.cc:2379] T f2019ede82614cedb5655ccbaf31cb8b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ebf87da4c94e46a875293608ddad04 in current term 1: Already voted for candidate a7834062bf084f9cabbff4788a79d2a9 in this term.
I20240501 19:57:29.703513 18146 leader_election.cc:302] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.703675 18480 raft_consensus.cc:3037] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.704393 18480 raft_consensus.cc:2726] T f2019ede82614cedb5655ccbaf31cb8b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.715960 18551 raft_consensus.cc:482] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.716063 18551 raft_consensus.cc:504] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.716338 18354 raft_consensus.cc:482] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.716444 18354 raft_consensus.cc:504] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.716534 18551 leader_election.cc:288] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.716766 18354 leader_election.cc:288] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.716763 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5c99ef38464bb4997b2aef8807b765" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.716854 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5c99ef38464bb4997b2aef8807b765" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.716914 18101 raft_consensus.cc:2454] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.716953 18178 raft_consensus.cc:2454] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.717001 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c63719b49c4ceda03621bd77c91ff6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.717106 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c63719b49c4ceda03621bd77c91ff6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.717170 18220 leader_election.cc:302] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.717229 18180 raft_consensus.cc:2454] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.717105 18254 raft_consensus.cc:2454] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.717291 18551 raft_consensus.cc:2781] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.717342 18551 raft_consensus.cc:482] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.717391 18551 raft_consensus.cc:3037] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.717489 18067 leader_election.cc:302] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.717623 18354 raft_consensus.cc:2781] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.717682 18354 raft_consensus.cc:482] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.717721 18354 raft_consensus.cc:3037] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.718338 18551 raft_consensus.cc:504] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.718477 18354 raft_consensus.cc:504] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.718698 18551 leader_election.cc:288] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.718747 18354 leader_election.cc:288] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.718917 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5c99ef38464bb4997b2aef8807b765" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.718914 18180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c63719b49c4ceda03621bd77c91ff6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.719023 18101 raft_consensus.cc:3037] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.719065 18180 raft_consensus.cc:3037] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.719161 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b5c99ef38464bb4997b2aef8807b765" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.719261 18178 raft_consensus.cc:3037] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.719769 18180 raft_consensus.cc:2454] T e7c63719b49c4ceda03621bd77c91ff6 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.719863 18101 raft_consensus.cc:2454] T 2b5c99ef38464bb4997b2aef8807b765 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.719053 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c63719b49c4ceda03621bd77c91ff6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.719980 18254 raft_consensus.cc:3037] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.720031 18067 leader_election.cc:302] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7834062bf084f9cabbff4788a79d2a9, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.720034 18178 raft_consensus.cc:2454] T 2b5c99ef38464bb4997b2aef8807b765 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.720256 18354 raft_consensus.cc:2781] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.720320 18354 raft_consensus.cc:686] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.720378 18220 leader_election.cc:302] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.720433 18354 consensus_queue.cc:237] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.720552 18331 raft_consensus.cc:482] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.720631 18331 raft_consensus.cc:504] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.720867 18254 raft_consensus.cc:2454] T e7c63719b49c4ceda03621bd77c91ff6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.720954 18331 leader_election.cc:288] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.721051 18331 raft_consensus.cc:2781] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.721135 18331 raft_consensus.cc:686] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.721287 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65eb080a29294efeb39e2c29a008181f" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.721252 18331 consensus_queue.cc:237] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.721364 18101 raft_consensus.cc:2454] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.721633 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65eb080a29294efeb39e2c29a008181f" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.721720 18178 raft_consensus.cc:2454] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 0.
I20240501 19:57:29.721971 18218 leader_election.cc:302] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.722131 18331 raft_consensus.cc:2781] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.722203 18331 raft_consensus.cc:482] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.722251 18331 raft_consensus.cc:3037] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.722668 17998 catalog_manager.cc:5484] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.722923 18331 raft_consensus.cc:504] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.723228 18331 leader_election.cc:288] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Requested vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:29.723484 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65eb080a29294efeb39e2c29a008181f" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.723579 18178 raft_consensus.cc:3037] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.723522 17999 catalog_manager.cc:5484] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.724071 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65eb080a29294efeb39e2c29a008181f" candidate_uuid: "030d4bb74d5046d98e41d25d74fce3f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9"
I20240501 19:57:29.724162 18101 raft_consensus.cc:3037] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.724470 18178 raft_consensus.cc:2454] T 65eb080a29294efeb39e2c29a008181f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.724766 18218 leader_election.cc:302] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, d7ebf87da4c94e46a875293608ddad04; no voters:
I20240501 19:57:29.724967 18331 raft_consensus.cc:2781] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.725164 18331 raft_consensus.cc:686] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Becoming Leader. State: Replica: 030d4bb74d5046d98e41d25d74fce3f5, State: Running, Role: LEADER
I20240501 19:57:29.725293 18331 consensus_queue.cc:237] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.724978 18101 raft_consensus.cc:2454] T 65eb080a29294efeb39e2c29a008181f P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 030d4bb74d5046d98e41d25d74fce3f5 in term 1.
I20240501 19:57:29.727129 17999 catalog_manager.cc:5484] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3). New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } }
I20240501 19:57:29.727545 18331 consensus_queue.cc:1035] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.729702 18178 raft_consensus.cc:3037] T 9c252400bfbc43eda2e4f222ee9a4230 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.730898 18351 consensus_queue.cc:1035] T 9c252400bfbc43eda2e4f222ee9a4230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.741019 18480 consensus_queue.cc:1035] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.742172 18351 consensus_queue.cc:1035] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.744771 18302 consensus_queue.cc:1035] T 35e7e35b622f44e08a530601ac203994 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.745899 18304 consensus_queue.cc:1035] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.745932 18302 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.750424 18254 raft_consensus.cc:3037] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.751684 18410 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.757091 18305 raft_consensus.cc:482] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.757174 18305 raft_consensus.cc:504] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.757535 18305 leader_election.cc:288] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.757826 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4add94039d71435ea2a6616ac3746de6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.757804 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4add94039d71435ea2a6616ac3746de6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04" is_pre_election: true
I20240501 19:57:29.757961 18254 raft_consensus.cc:2454] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.758033 18178 raft_consensus.cc:2454] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 0.
I20240501 19:57:29.758268 18305 consensus_queue.cc:1035] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.758306 18070 leader_election.cc:302] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.758493 18354 raft_consensus.cc:2781] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 19:57:29.758565 18354 raft_consensus.cc:482] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 19:57:29.758602 18354 raft_consensus.cc:3037] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.759430 18354 raft_consensus.cc:504] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.759780 18354 leader_election.cc:288] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Requested vote from peers d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.760286 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4add94039d71435ea2a6616ac3746de6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5"
I20240501 19:57:29.760376 18255 raft_consensus.cc:3037] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.760598 18353 consensus_queue.cc:1035] T 8e999d46100b4fd39bbee770470a6967 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.761041 18178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4add94039d71435ea2a6616ac3746de6" candidate_uuid: "a7834062bf084f9cabbff4788a79d2a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7ebf87da4c94e46a875293608ddad04"
I20240501 19:57:29.761130 18178 raft_consensus.cc:3037] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.761291 18255 raft_consensus.cc:2454] T 4add94039d71435ea2a6616ac3746de6 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.761569 18070 leader_election.cc:302] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9; no voters:
I20240501 19:57:29.761736 18354 raft_consensus.cc:2781] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 19:57:29.761822 18354 raft_consensus.cc:686] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Becoming Leader. State: Replica: a7834062bf084f9cabbff4788a79d2a9, State: Running, Role: LEADER
I20240501 19:57:29.761957 18354 consensus_queue.cc:237] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.761962 18178 raft_consensus.cc:2454] T 4add94039d71435ea2a6616ac3746de6 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a7834062bf084f9cabbff4788a79d2a9 in term 1.
I20240501 19:57:29.763681 18578 consensus_queue.cc:1035] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.764739 17998 catalog_manager.cc:5484] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1). New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:29.767012 18305 consensus_queue.cc:1035] T 3d466985b37e4bd58a2920fe6008093d P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.773999 18410 consensus_queue.cc:1035] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.776556 18410 consensus_queue.cc:1035] T 5e3f8dc551384672a732e4f400999213 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.777781 18410 consensus_queue.cc:1035] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.780866 18410 consensus_queue.cc:1035] T f5b3b0c7c59d4aa099df0a2f4cf8447e P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.793052 18305 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.796233 18305 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.798957 18101 raft_consensus.cc:3037] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.800076 18331 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.802554 18551 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.810894 18551 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.813263 18304 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.820679 18304 consensus_queue.cc:1035] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.823158 18351 consensus_queue.cc:1035] T ae0b1e22eede490e983dd3fe8e3ae9f5 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.825289 18351 consensus_queue.cc:1035] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.826249 17004 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 19:57:29.828595 18331 consensus_queue.cc:1035] T 4fee40f19ff4468aa38a3d28b189ee56 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 19:57:29.829578 18597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 19:57:29.830258 18596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:29.832201 17004 server_base.cc:1034] running on GCE node
I20240501 19:57:29.832655 18331 consensus_queue.cc:1035] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.835929 18351 consensus_queue.cc:1035] T ac1c6a7daf194214a76880a6b4d1edc9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 19:57:29.835973 18599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 19:57:29.839619 17004 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 19:57:29.839682 17004 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 19:57:29.839707 17004 hybrid_clock.cc:648] HybridClock initialized: now 1714593449839706 us; error 0 us; skew 500 ppm
I20240501 19:57:29.840713 17004 webserver.cc:460] Webserver started at http://127.16.155.4:40285/ using document root <none> and password file <none>
I20240501 19:57:29.840834 17004 fs_manager.cc:359] Metadata directory not provided
I20240501 19:57:29.840873 17004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 19:57:29.840929 17004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 19:57:29.841260 17004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-3-root/instance:
uuid: "0ecba761eea842c18c5f5abf24f9bf68"
format_stamp: "Formatted at 2024-05-01 19:57:29 on dist-test-slave-4377"
I20240501 19:57:29.842835 17004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:29.843685 18607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:29.843958 17004 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:29.844027 17004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-3-root
uuid: "0ecba761eea842c18c5f5abf24f9bf68"
format_stamp: "Formatted at 2024-05-01 19:57:29 on dist-test-slave-4377"
I20240501 19:57:29.844112 17004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 19:57:29.846194 18351 consensus_queue.cc:1035] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.848591 18178 raft_consensus.cc:3037] T 09a85049bcb54ab3997e07ab7f564c77 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.849177 18410 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.849907 18304 consensus_queue.cc:1035] T 09a85049bcb54ab3997e07ab7f564c77 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.853120 18302 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.855590 18328 raft_consensus.cc:482] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 19:57:29.855693 18328 raft_consensus.cc:504] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } }
I20240501 19:57:29.856035 18328 leader_election.cc:288] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571), 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:29.856326 18255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "030d4bb74d5046d98e41d25d74fce3f5" is_pre_election: true
I20240501 19:57:29.857085 18101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e38554d7de3475f9352b913e4f2a87c" candidate_uuid: "d7ebf87da4c94e46a875293608ddad04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7834062bf084f9cabbff4788a79d2a9" is_pre_election: true
I20240501 19:57:29.857187 18101 raft_consensus.cc:2379] T 3e38554d7de3475f9352b913e4f2a87c P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7ebf87da4c94e46a875293608ddad04 in current term 1: Already voted for candidate 030d4bb74d5046d98e41d25d74fce3f5 in this term.
I20240501 19:57:29.857600 18145 leader_election.cc:302] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7ebf87da4c94e46a875293608ddad04; no voters: 030d4bb74d5046d98e41d25d74fce3f5, a7834062bf084f9cabbff4788a79d2a9
I20240501 19:57:29.857730 18302 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.857945 18302 raft_consensus.cc:3037] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.858608 18302 raft_consensus.cc:2726] T 3e38554d7de3475f9352b913e4f2a87c P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 19:57:29.862769 18328 consensus_queue.cc:1035] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.863354 18328 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.868360 18328 consensus_queue.cc:1035] T dfe1b770b027404a81b4bc7a4080e3ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.869331 17004 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 19:57:29.869725 17004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 19:57:29.869984 17004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 19:57:29.870388 17004 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 19:57:29.870429 17004 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:29.870473 17004 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 19:57:29.870498 17004 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 19:57:29.874404 18331 consensus_queue.cc:1035] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.876472 17004 rpc_server.cc:307] RPC server started. Bound to: 127.16.155.4:44927
I20240501 19:57:29.876554 18679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.16.155.4:44927 every 8 connection(s)
I20240501 19:57:29.876950 17004 auto_leader_rebalancer-test.cc:405] add a tserver: 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:29.877729 18331 consensus_queue.cc:1035] T 6dc61f5a2be4433385c75108851784d7 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.882627 18680 heartbeater.cc:347] Connected to a master server at 127.16.155.62:38023
I20240501 19:57:29.882704 18680 heartbeater.cc:464] Registering TS with master...
I20240501 19:57:29.882895 18680 heartbeater.cc:511] Master 127.16.155.62:38023 requested a full tablet report, sending...
I20240501 19:57:29.883332 18000 ts_manager.cc:194] Registered new tserver with Master: 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927)
I20240501 19:57:29.883809 18000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34946
I20240501 19:57:29.883960 18178 raft_consensus.cc:3037] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 0 FOLLOWER]: Advancing to term 1
I20240501 19:57:29.884934 18304 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.887231 18351 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.888530 18551 consensus_queue.cc:1035] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.889130 18328 consensus_queue.cc:1035] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.893503 18328 consensus_queue.cc:1035] T 7e9ae0611714476599196cbc902d5f66 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.893898 18331 consensus_queue.cc:1035] T 88369b2534e44de0a090bd8eaa461755 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.896497 18305 consensus_queue.cc:1035] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.899118 18578 consensus_queue.cc:1035] T 0d7bd95fff5b4435bbb1825d1fb0ede2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.902791 18578 consensus_queue.cc:1035] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.903671 18304 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.905318 18328 consensus_queue.cc:1035] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.907459 18353 consensus_queue.cc:1035] T 7c343b15b92a4d84a539e3122ed85ef2 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.909154 18410 consensus_queue.cc:1035] T 74d386ffed734860bb531b7b950da488 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.910094 18551 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.913450 18410 consensus_queue.cc:1035] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.913667 18331 consensus_queue.cc:1035] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.915664 18331 consensus_queue.cc:1035] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.916033 18331 consensus_queue.cc:1035] T ffbfd18ef4fc4fe393e9915ad65c69cf P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.917797 18410 consensus_queue.cc:1035] T fd26327aee2e4181baeab9dd52e5fa02 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.919986 18351 consensus_queue.cc:1035] T 1ba4c26eae1f4731982f3bb0485eace9 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.936369 18305 consensus_queue.cc:1035] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.939348 18354 consensus_queue.cc:1035] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.946426 18354 consensus_queue.cc:1035] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.948640 18305 consensus_queue.cc:1035] T d9e0f2e994d247ff90b3bf5f2f124e35 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.962450 18410 consensus_queue.cc:1035] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.964697 18478 consensus_queue.cc:1035] T 2c406ab4a99549fabe2bd60919a725a8 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.988080 18305 consensus_queue.cc:1035] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:29.990499 18354 consensus_queue.cc:1035] T 478eb3c7c83d4d9a9f329163435d8389 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.006675 18304 consensus_queue.cc:1035] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.009239 18551 consensus_queue.cc:1035] T 1712a8811770442ebe9a94ac36f23362 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.023602 18328 consensus_queue.cc:1035] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.026048 18328 consensus_queue.cc:1035] T 3276a6a9232549b5bdc1a82b2ebaefc2 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.040918 18354 consensus_queue.cc:1035] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.043357 18354 consensus_queue.cc:1035] T d00f74f62f4d43888bfd5ac0dbdacd8a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.056744 18354 consensus_queue.cc:1035] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.059232 18353 consensus_queue.cc:1035] T f2019ede82614cedb5655ccbaf31cb8b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.063726 18304 consensus_queue.cc:1035] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.064978 18304 consensus_queue.cc:1035] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.067013 18331 consensus_queue.cc:1035] T 3e38554d7de3475f9352b913e4f2a87c P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.068310 18551 consensus_queue.cc:1035] T 590f797b1246400988d4177b27acd261 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.085913 18304 consensus_queue.cc:1035] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.088492 18351 consensus_queue.cc:1035] T bc7844cb8be7435ebb038b6340f6b27a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.090071 18328 consensus_queue.cc:1035] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.092864 18478 consensus_queue.cc:1035] T 2b73caad778849b0b6c7cb625d4f0f24 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.105232 18353 consensus_queue.cc:1035] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.107497 18305 consensus_queue.cc:1035] T 1c0cdf9414db4baa9427c85c30d79e0a P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.109452 18351 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.111919 18351 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.115552 18351 consensus_queue.cc:1035] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.117847 18551 consensus_queue.cc:1035] T dfdbeb1209494eaf9b58c3f5452d3549 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.165082 18478 consensus_queue.cc:1035] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.167472 18354 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.167924 18478 consensus_queue.cc:1035] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.171063 18354 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.181990 18354 consensus_queue.cc:1035] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.184312 18354 consensus_queue.cc:1035] T e7c63719b49c4ceda03621bd77c91ff6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.230324 18351 consensus_queue.cc:1035] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.232987 18304 consensus_queue.cc:1035] T b98df59ebac64a7b8d40f0b227cdf42a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.241762 18304 consensus_queue.cc:1035] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.241822 18351 consensus_queue.cc:1035] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.244514 18551 consensus_queue.cc:1035] T 2b5c99ef38464bb4997b2aef8807b765 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.246090 18551 consensus_queue.cc:1035] T 65eb080a29294efeb39e2c29a008181f P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.252857 18354 consensus_queue.cc:1035] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.255218 18353 consensus_queue.cc:1035] T 4add94039d71435ea2a6616ac3746de6 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 19:57:30.852968 18255 consensus_queue.cc:237] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:30.854342 18178 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.854349 18101 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.854692 18331 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.854861 18304 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.856366 18304 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.856729 18101 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.857034 18178 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
W20240501 19:57:30.859520 18218 consensus_peers.cc:485] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ae71a6ccffe4c1f908ccae0efba2841. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:30.860381 18001 catalog_manager.cc:5484] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.864112 18178 consensus_queue.cc:237] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:30.865288 18255 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.865398 18101 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.865684 18478 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.865860 18410 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.868933 18478 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
W20240501 19:57:30.869345 18143 consensus_peers.cc:485] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2cfee7a6c48e487f84b2dd8c708314cd. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:30.870560 18101 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.871461 18000 catalog_manager.cc:5484] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:30.871887 18255 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.873039 18178 consensus_queue.cc:237] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:30.874274 18101 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.874554 18255 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.874605 18478 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 19:57:30.874763 18143 consensus_peers.cc:485] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d20a351a6427444e96bfc1828a990e92. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:30.875324 18410 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.878043 18410 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.878321 18254 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.878321 18101 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.880874 18001 catalog_manager.cc:5484] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.884160 18101 consensus_queue.cc:237] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:30.884512 18680 heartbeater.cc:503] Master 127.16.155.62:38023 was elected leader, sending a full tablet report...
I20240501 19:57:30.885507 18180 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.886049 18305 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.886067 18254 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:30.886602 18305 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:30.887648 18354 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.888542 18180 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:30.890615 18000 catalog_manager.cc:5484] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:30.891206 18254 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
W20240501 19:57:30.892587 18067 consensus_peers.cc:485] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 357676875d3b4ce190161065f07c507f. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:31.308081 18771 ts_tablet_manager.cc:902] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:31.308900 18771 tablet_copy_client.cc:308] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.3:42749
I20240501 19:57:31.312738 18265 tablet_copy_service.cc:140] P 030d4bb74d5046d98e41d25d74fce3f5: Received BeginTabletCopySession request for tablet 9ae71a6ccffe4c1f908ccae0efba2841 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:36180)
I20240501 19:57:31.312861 18265 tablet_copy_service.cc:161] P 030d4bb74d5046d98e41d25d74fce3f5: Beginning new tablet copy session on tablet 9ae71a6ccffe4c1f908ccae0efba2841 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:36180: session id = 0ecba761eea842c18c5f5abf24f9bf68-9ae71a6ccffe4c1f908ccae0efba2841
I20240501 19:57:31.314088 18777 ts_tablet_manager.cc:902] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571)
I20240501 19:57:31.314360 18265 tablet_copy_source_session.cc:205] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:31.314643 18777 tablet_copy_client.cc:308] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.1:43571
I20240501 19:57:31.315577 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ae71a6ccffe4c1f908ccae0efba2841. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:31.317885 18771 tablet_copy_client.cc:783] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:31.318054 18771 tablet_copy_client.cc:647] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:31.318606 18114 tablet_copy_service.cc:140] P a7834062bf084f9cabbff4788a79d2a9: Received BeginTabletCopySession request for tablet 357676875d3b4ce190161065f07c507f from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:56004)
I20240501 19:57:31.318696 18114 tablet_copy_service.cc:161] P a7834062bf084f9cabbff4788a79d2a9: Beginning new tablet copy session on tablet 357676875d3b4ce190161065f07c507f from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:56004: session id = 0ecba761eea842c18c5f5abf24f9bf68-357676875d3b4ce190161065f07c507f
I20240501 19:57:31.319538 18114 tablet_copy_source_session.cc:205] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:31.320261 18777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 357676875d3b4ce190161065f07c507f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:31.320919 18771 tablet_copy_client.cc:523] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:31.322310 18777 tablet_copy_client.cc:783] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:31.322443 18777 tablet_copy_client.cc:647] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:31.323065 18771 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:31.324232 18777 tablet_copy_client.cc:523] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:31.325438 18777 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:31.327960 18771 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:31.328233 18771 tablet_bootstrap.cc:492] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:31.328388 18771 ts_tablet_manager.cc:1367] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240501 19:57:31.328838 18771 raft_consensus.cc:348] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.328974 18771 raft_consensus.cc:729] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:31.329092 18771 consensus_queue.cc:260] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.329500 18771 ts_tablet_manager.cc:1398] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:31.329586 18777 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:31.329800 18777 tablet_bootstrap.cc:492] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:31.329964 18777 ts_tablet_manager.cc:1367] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20240501 19:57:31.330329 18265 tablet_copy_service.cc:342] P 030d4bb74d5046d98e41d25d74fce3f5: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-9ae71a6ccffe4c1f908ccae0efba2841 received from {username='slave'} at 127.0.0.1:36180
I20240501 19:57:31.330420 18265 tablet_copy_service.cc:433] P 030d4bb74d5046d98e41d25d74fce3f5: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-9ae71a6ccffe4c1f908ccae0efba2841 on tablet 9ae71a6ccffe4c1f908ccae0efba2841 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:31.330346 18777 raft_consensus.cc:348] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.330901 18777 raft_consensus.cc:729] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:31.331028 18777 consensus_queue.cc:260] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.331293 18777 ts_tablet_manager.cc:1398] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 19:57:31.331761 18114 tablet_copy_service.cc:342] P a7834062bf084f9cabbff4788a79d2a9: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-357676875d3b4ce190161065f07c507f received from {username='slave'} at 127.0.0.1:56004
I20240501 19:57:31.331838 18114 tablet_copy_service.cc:433] P a7834062bf084f9cabbff4788a79d2a9: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-357676875d3b4ce190161065f07c507f on tablet 357676875d3b4ce190161065f07c507f with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:31.351636 18777 ts_tablet_manager.cc:902] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:31.352126 18777 tablet_copy_client.cc:308] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.2:34865
I20240501 19:57:31.355811 18190 tablet_copy_service.cc:140] P d7ebf87da4c94e46a875293608ddad04: Received BeginTabletCopySession request for tablet d20a351a6427444e96bfc1828a990e92 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:34674)
I20240501 19:57:31.355906 18190 tablet_copy_service.cc:161] P d7ebf87da4c94e46a875293608ddad04: Beginning new tablet copy session on tablet d20a351a6427444e96bfc1828a990e92 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:34674: session id = 0ecba761eea842c18c5f5abf24f9bf68-d20a351a6427444e96bfc1828a990e92
I20240501 19:57:31.356914 18190 tablet_copy_source_session.cc:205] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:31.357762 18777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d20a351a6427444e96bfc1828a990e92. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:31.359956 18777 tablet_copy_client.cc:783] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:31.360131 18777 tablet_copy_client.cc:647] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:31.361053 18777 tablet_copy_client.cc:523] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:31.362151 18777 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:31.365850 18777 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:31.366104 18777 tablet_bootstrap.cc:492] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:31.366263 18777 ts_tablet_manager.cc:1367] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20240501 19:57:31.366640 18777 raft_consensus.cc:348] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.366763 18777 raft_consensus.cc:729] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:31.366860 18777 consensus_queue.cc:260] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.367154 18777 ts_tablet_manager.cc:1398] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:31.367544 18190 tablet_copy_service.cc:342] P d7ebf87da4c94e46a875293608ddad04: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d20a351a6427444e96bfc1828a990e92 received from {username='slave'} at 127.0.0.1:34674
I20240501 19:57:31.367614 18190 tablet_copy_service.cc:433] P d7ebf87da4c94e46a875293608ddad04: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d20a351a6427444e96bfc1828a990e92 on tablet d20a351a6427444e96bfc1828a990e92 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:31.374444 18777 ts_tablet_manager.cc:902] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:31.374855 18777 tablet_copy_client.cc:308] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.2:34865
I20240501 19:57:31.375226 18190 tablet_copy_service.cc:140] P d7ebf87da4c94e46a875293608ddad04: Received BeginTabletCopySession request for tablet 2cfee7a6c48e487f84b2dd8c708314cd from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:34674)
I20240501 19:57:31.375325 18190 tablet_copy_service.cc:161] P d7ebf87da4c94e46a875293608ddad04: Beginning new tablet copy session on tablet 2cfee7a6c48e487f84b2dd8c708314cd from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:34674: session id = 0ecba761eea842c18c5f5abf24f9bf68-2cfee7a6c48e487f84b2dd8c708314cd
I20240501 19:57:31.375994 18190 tablet_copy_source_session.cc:205] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:31.376627 18777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2cfee7a6c48e487f84b2dd8c708314cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:31.378358 18777 tablet_copy_client.cc:783] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:31.378507 18777 tablet_copy_client.cc:647] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:31.379566 18777 tablet_copy_client.cc:523] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:31.380686 18777 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:31.383904 18777 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:31.384125 18777 tablet_bootstrap.cc:492] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:31.384274 18777 ts_tablet_manager.cc:1367] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240501 19:57:31.384693 18777 raft_consensus.cc:348] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.384833 18777 raft_consensus.cc:729] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:31.384943 18777 consensus_queue.cc:260] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:31.385233 18777 ts_tablet_manager.cc:1398] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:31.385705 18190 tablet_copy_service.cc:342] P d7ebf87da4c94e46a875293608ddad04: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-2cfee7a6c48e487f84b2dd8c708314cd received from {username='slave'} at 127.0.0.1:34674
I20240501 19:57:31.385777 18190 tablet_copy_service.cc:433] P d7ebf87da4c94e46a875293608ddad04: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-2cfee7a6c48e487f84b2dd8c708314cd on tablet 2cfee7a6c48e487f84b2dd8c708314cd with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:31.694341 18652 raft_consensus.cc:1203] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:31.833942 18652 raft_consensus.cc:1203] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:31.858232 18652 raft_consensus.cc:1203] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:31.863641 18652 raft_consensus.cc:1203] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:32.080611 18351 raft_consensus.cc:1050] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:32.081143 18351 consensus_queue.cc:237] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.082547 18101 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.082623 18180 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.082881 18652 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.082922 18801 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.083236 18304 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.083392 18351 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.085678 18351 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.086263 18178 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.086485 18652 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.088868 17998 catalog_manager.cc:5484] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.090579 18102 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.098471 18254 consensus_queue.cc:237] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.099634 18652 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.099864 18102 raft_consensus.cc:1261] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.100117 18801 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.100301 18796 consensus_queue.cc:1035] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.102296 18304 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.102962 18652 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.103827 17988 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9ae71a6ccffe4c1f908ccae0efba2841 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:32.104956 18102 raft_consensus.cc:2932] T 9ae71a6ccffe4c1f908ccae0efba2841 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.106257 18001 catalog_manager.cc:5484] T 9ae71a6ccffe4c1f908ccae0efba2841 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.111016 18166 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ae71a6ccffe4c1f908ccae0efba2841 with delete_type TABLET_DATA_TOMBSTONED (TS d7ebf87da4c94e46a875293608ddad04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34632
I20240501 19:57:32.111567 18809 tablet_replica.cc:330] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: stopping tablet replica
I20240501 19:57:32.111714 18809 raft_consensus.cc:2229] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:32.111842 18809 raft_consensus.cc:2258] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:32.112677 18809 ts_tablet_manager.cc:1875] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:32.114786 18809 ts_tablet_manager.cc:1888] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:32.114868 18809 log.cc:1196] T 9ae71a6ccffe4c1f908ccae0efba2841 P d7ebf87da4c94e46a875293608ddad04: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/wals/9ae71a6ccffe4c1f908ccae0efba2841
I20240501 19:57:32.115612 17985 catalog_manager.cc:4830] TS d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): tablet 9ae71a6ccffe4c1f908ccae0efba2841 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:32.303194 18795 raft_consensus.cc:1050] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:32.303597 18795 consensus_queue.cc:237] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.304708 18652 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.304785 18180 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.304991 18254 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.305087 18811 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.305449 18795 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.305655 18305 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.308279 18799 raft_consensus.cc:1050] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:32.308254 18795 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.308679 18799 consensus_queue.cc:237] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.310215 18653 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.310364 18652 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.310597 18102 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.310992 18254 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.311061 18798 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.311159 18255 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.312069 18000 catalog_manager.cc:5484] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:32.313125 18410 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.313359 18410 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.314893 18180 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.315939 18798 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.316267 18652 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.318063 18102 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.319119 18255 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.320053 18001 catalog_manager.cc:5484] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.321601 18102 consensus_queue.cc:237] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.322652 18255 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.322652 18652 raft_consensus.cc:1261] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.323024 18811 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.323406 18797 consensus_queue.cc:1035] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.324961 18180 consensus_queue.cc:237] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.326390 18101 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.327006 18255 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.327769 18653 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.327999 18652 raft_consensus.cc:1261] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.328253 18799 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.328541 18799 consensus_queue.cc:1035] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.330098 18799 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.330197 17998 catalog_manager.cc:5484] T 357676875d3b4ce190161065f07c507f P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.327044 18797 raft_consensus.cc:2932] T 357676875d3b4ce190161065f07c507f P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.330576 18102 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.332053 17985 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2cfee7a6c48e487f84b2dd8c708314cd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:32.332222 17987 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 357676875d3b4ce190161065f07c507f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:32.333240 18166 tablet_service.cc:1514] Processing DeleteTablet for tablet 357676875d3b4ce190161065f07c507f with delete_type TABLET_DATA_TOMBSTONED (TS d7ebf87da4c94e46a875293608ddad04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34632
I20240501 19:57:32.333434 18809 tablet_replica.cc:330] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: stopping tablet replica
I20240501 19:57:32.333698 18809 raft_consensus.cc:2229] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:32.333395 17998 catalog_manager.cc:5484] T 2cfee7a6c48e487f84b2dd8c708314cd P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:32.333858 18809 raft_consensus.cc:2258] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:32.334672 18809 ts_tablet_manager.cc:1875] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:32.336026 18242 tablet_service.cc:1514] Processing DeleteTablet for tablet 2cfee7a6c48e487f84b2dd8c708314cd with delete_type TABLET_DATA_TOMBSTONED (TS 030d4bb74d5046d98e41d25d74fce3f5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36150
I20240501 19:57:32.336586 18820 tablet_replica.cc:330] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: stopping tablet replica
I20240501 19:57:32.336714 18820 raft_consensus.cc:2229] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:32.336660 18652 raft_consensus.cc:2932] T 2cfee7a6c48e487f84b2dd8c708314cd P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.336829 18809 ts_tablet_manager.cc:1888] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:32.336828 18820 raft_consensus.cc:2258] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:32.336925 18809 log.cc:1196] T 357676875d3b4ce190161065f07c507f P d7ebf87da4c94e46a875293608ddad04: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/wals/357676875d3b4ce190161065f07c507f
I20240501 19:57:32.337460 18820 ts_tablet_manager.cc:1875] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:32.337756 17985 catalog_manager.cc:4830] TS d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): tablet 357676875d3b4ce190161065f07c507f (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:32.340643 18820 ts_tablet_manager.cc:1888] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:32.340704 18820 log.cc:1196] T 2cfee7a6c48e487f84b2dd8c708314cd P 030d4bb74d5046d98e41d25d74fce3f5: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/wals/2cfee7a6c48e487f84b2dd8c708314cd
I20240501 19:57:32.341120 17988 catalog_manager.cc:4830] TS 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): tablet 2cfee7a6c48e487f84b2dd8c708314cd (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:32.473884 18816 raft_consensus.cc:1050] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:32.474396 18816 consensus_queue.cc:237] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.475690 18652 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.475750 18255 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.476042 18799 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.476351 18798 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.476680 18104 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:32.477015 18798 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:32.478529 18799 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.478894 18104 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.480728 18255 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.481439 17998 catalog_manager.cc:5484] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.483335 18652 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.487756 18179 consensus_queue.cc:237] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:32.488678 18255 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.488703 18652 raft_consensus.cc:1261] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:32.488958 18410 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.489272 18410 consensus_queue.cc:1035] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:32.490375 18816 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.490759 18255 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.492384 17985 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d20a351a6427444e96bfc1828a990e92 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:32.492470 18652 raft_consensus.cc:2932] T d20a351a6427444e96bfc1828a990e92 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.493283 17999 catalog_manager.cc:5484] T d20a351a6427444e96bfc1828a990e92 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:32.495580 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet d20a351a6427444e96bfc1828a990e92 with delete_type TABLET_DATA_TOMBSTONED (TS a7834062bf084f9cabbff4788a79d2a9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55982
I20240501 19:57:32.495988 18825 tablet_replica.cc:330] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: stopping tablet replica
I20240501 19:57:32.496160 18825 raft_consensus.cc:2229] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:32.496300 18825 raft_consensus.cc:2258] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:32.496805 18825 ts_tablet_manager.cc:1875] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:32.498487 18825 ts_tablet_manager.cc:1888] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:32.498551 18825 log.cc:1196] T d20a351a6427444e96bfc1828a990e92 P a7834062bf084f9cabbff4788a79d2a9: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/wals/d20a351a6427444e96bfc1828a990e92
I20240501 19:57:32.498977 17987 catalog_manager.cc:4830] TS a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): tablet d20a351a6427444e96bfc1828a990e92 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:33.503525 18101 consensus_queue.cc:237] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.505057 18255 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:33.505100 18067 consensus_peers.cc:485] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 819cf24be08746ab892f903e3119392b. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:33.505383 18179 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.505446 18305 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.505775 18826 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.507207 18305 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.507653 18255 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.508073 18179 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.510346 17998 catalog_manager.cc:5484] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.511476 18255 consensus_queue.cc:237] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.512758 18101 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.512830 18179 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.513139 18801 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 19:57:33.514012 18218 consensus_peers.cc:485] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d193261354994d2db384d9db69a5b463. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:33.514130 18801 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.514683 18796 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.515111 18101 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.516924 18255 consensus_queue.cc:237] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.517385 18000 catalog_manager.cc:5484] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:33.518539 18178 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:33.518754 18218 consensus_peers.cc:485] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9f7b594299448a09fa4aefe5af61230. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:33.518930 18827 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.519024 18179 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.520393 18101 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.520960 18801 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.521221 18842 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.521602 18178 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.523270 18178 consensus_queue.cc:237] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.523257 18102 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.524719 18102 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.525117 18255 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:33.525439 18845 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.525564 17999 catalog_manager.cc:5484] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240501 19:57:33.525825 18143 consensus_peers.cc:485] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a43eb46633f4a25b08b84779c0d64ae. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:33.526058 18832 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:33.528772 18799 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.529155 18102 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.530525 18255 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.531303 17998 catalog_manager.cc:5484] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:33.950400 18848 ts_tablet_manager.cc:902] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:33.950996 18848 tablet_copy_client.cc:308] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.3:42749
I20240501 19:57:33.952623 18265 tablet_copy_service.cc:140] P 030d4bb74d5046d98e41d25d74fce3f5: Received BeginTabletCopySession request for tablet d193261354994d2db384d9db69a5b463 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:36180)
I20240501 19:57:33.952706 18265 tablet_copy_service.cc:161] P 030d4bb74d5046d98e41d25d74fce3f5: Beginning new tablet copy session on tablet d193261354994d2db384d9db69a5b463 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:36180: session id = 0ecba761eea842c18c5f5abf24f9bf68-d193261354994d2db384d9db69a5b463
I20240501 19:57:33.953604 18265 tablet_copy_source_session.cc:205] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:33.954380 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d193261354994d2db384d9db69a5b463. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:33.956738 18848 tablet_copy_client.cc:783] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:33.956876 18848 tablet_copy_client.cc:647] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:33.957885 18848 tablet_copy_client.cc:523] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:33.958935 18848 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:33.962280 18848 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:33.962520 18848 tablet_bootstrap.cc:492] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:33.962678 18848 ts_tablet_manager.cc:1367] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 19:57:33.963065 18848 raft_consensus.cc:348] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.963163 18848 raft_consensus.cc:729] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:33.963270 18848 consensus_queue.cc:260] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.963649 18848 ts_tablet_manager.cc:1398] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:33.964035 18265 tablet_copy_service.cc:342] P 030d4bb74d5046d98e41d25d74fce3f5: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d193261354994d2db384d9db69a5b463 received from {username='slave'} at 127.0.0.1:36180
I20240501 19:57:33.964103 18265 tablet_copy_service.cc:433] P 030d4bb74d5046d98e41d25d74fce3f5: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d193261354994d2db384d9db69a5b463 on tablet d193261354994d2db384d9db69a5b463 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:33.976832 18848 ts_tablet_manager.cc:902] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:33.977267 18848 tablet_copy_client.cc:308] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.2:34865
I20240501 19:57:33.977638 18190 tablet_copy_service.cc:140] P d7ebf87da4c94e46a875293608ddad04: Received BeginTabletCopySession request for tablet 0a43eb46633f4a25b08b84779c0d64ae from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:34674)
I20240501 19:57:33.977733 18190 tablet_copy_service.cc:161] P d7ebf87da4c94e46a875293608ddad04: Beginning new tablet copy session on tablet 0a43eb46633f4a25b08b84779c0d64ae from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:34674: session id = 0ecba761eea842c18c5f5abf24f9bf68-0a43eb46633f4a25b08b84779c0d64ae
I20240501 19:57:33.978520 18190 tablet_copy_source_session.cc:205] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:33.979221 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a43eb46633f4a25b08b84779c0d64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:33.981200 18848 tablet_copy_client.cc:783] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:33.981420 18848 tablet_copy_client.cc:647] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:33.982432 18848 tablet_copy_client.cc:523] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:33.983544 18848 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:33.985859 18859 ts_tablet_manager.cc:902] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:33.986332 18859 tablet_copy_client.cc:308] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.3:42749
I20240501 19:57:33.986927 18265 tablet_copy_service.cc:140] P 030d4bb74d5046d98e41d25d74fce3f5: Received BeginTabletCopySession request for tablet d9f7b594299448a09fa4aefe5af61230 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:36180)
I20240501 19:57:33.987032 18265 tablet_copy_service.cc:161] P 030d4bb74d5046d98e41d25d74fce3f5: Beginning new tablet copy session on tablet d9f7b594299448a09fa4aefe5af61230 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:36180: session id = 0ecba761eea842c18c5f5abf24f9bf68-d9f7b594299448a09fa4aefe5af61230
I20240501 19:57:33.987057 18848 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:33.987289 18848 tablet_bootstrap.cc:492] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:33.987449 18848 ts_tablet_manager.cc:1367] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240501 19:57:33.987793 18265 tablet_copy_source_session.cc:205] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:33.988143 18848 raft_consensus.cc:348] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.988266 18848 raft_consensus.cc:729] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:33.988392 18848 consensus_queue.cc:260] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.988502 18859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9f7b594299448a09fa4aefe5af61230. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:33.988665 18848 ts_tablet_manager.cc:1398] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:33.989332 18190 tablet_copy_service.cc:342] P d7ebf87da4c94e46a875293608ddad04: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-0a43eb46633f4a25b08b84779c0d64ae received from {username='slave'} at 127.0.0.1:34674
I20240501 19:57:33.989396 18190 tablet_copy_service.cc:433] P d7ebf87da4c94e46a875293608ddad04: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-0a43eb46633f4a25b08b84779c0d64ae on tablet 0a43eb46633f4a25b08b84779c0d64ae with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:33.990741 18859 tablet_copy_client.cc:783] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:33.990875 18859 tablet_copy_client.cc:647] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:33.991830 18859 tablet_copy_client.cc:523] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:33.992971 18859 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:33.996479 18859 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:33.996733 18859 tablet_bootstrap.cc:492] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:33.996891 18859 ts_tablet_manager.cc:1367] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 19:57:33.997294 18859 raft_consensus.cc:348] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.997408 18859 raft_consensus.cc:729] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:33.997506 18859 consensus_queue.cc:260] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:33.997792 18859 ts_tablet_manager.cc:1398] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:33.998239 18265 tablet_copy_service.cc:342] P 030d4bb74d5046d98e41d25d74fce3f5: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d9f7b594299448a09fa4aefe5af61230 received from {username='slave'} at 127.0.0.1:36180
I20240501 19:57:33.998313 18265 tablet_copy_service.cc:433] P 030d4bb74d5046d98e41d25d74fce3f5: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-d9f7b594299448a09fa4aefe5af61230 on tablet d9f7b594299448a09fa4aefe5af61230 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:34.064117 18859 ts_tablet_manager.cc:902] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571)
I20240501 19:57:34.064642 18859 tablet_copy_client.cc:308] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.1:43571
I20240501 19:57:34.065032 18114 tablet_copy_service.cc:140] P a7834062bf084f9cabbff4788a79d2a9: Received BeginTabletCopySession request for tablet 819cf24be08746ab892f903e3119392b from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:56004)
I20240501 19:57:34.065128 18114 tablet_copy_service.cc:161] P a7834062bf084f9cabbff4788a79d2a9: Beginning new tablet copy session on tablet 819cf24be08746ab892f903e3119392b from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:56004: session id = 0ecba761eea842c18c5f5abf24f9bf68-819cf24be08746ab892f903e3119392b
I20240501 19:57:34.066215 18114 tablet_copy_source_session.cc:205] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:34.067129 18859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 819cf24be08746ab892f903e3119392b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:34.069299 18859 tablet_copy_client.cc:783] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:34.069460 18859 tablet_copy_client.cc:647] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:34.070688 18859 tablet_copy_client.cc:523] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:34.071848 18859 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:34.075407 18859 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:34.075743 18859 tablet_bootstrap.cc:492] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:34.075915 18859 ts_tablet_manager.cc:1367] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.001s
I20240501 19:57:34.076298 18859 raft_consensus.cc:348] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:34.076427 18859 raft_consensus.cc:729] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:34.076540 18859 consensus_queue.cc:260] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:34.076808 18859 ts_tablet_manager.cc:1398] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:34.077198 18114 tablet_copy_service.cc:342] P a7834062bf084f9cabbff4788a79d2a9: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-819cf24be08746ab892f903e3119392b received from {username='slave'} at 127.0.0.1:56004
I20240501 19:57:34.077270 18114 tablet_copy_service.cc:433] P a7834062bf084f9cabbff4788a79d2a9: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-819cf24be08746ab892f903e3119392b on tablet 819cf24be08746ab892f903e3119392b with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:34.431861 18652 raft_consensus.cc:1203] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:34.489425 18652 raft_consensus.cc:1203] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:34.537822 18652 raft_consensus.cc:1203] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:34.625823 18652 raft_consensus.cc:1203] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:34.838451 18866 raft_consensus.cc:1050] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:34.838907 18866 consensus_queue.cc:237] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.840101 18180 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.840207 18652 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.840436 18842 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.840582 18101 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.840622 18866 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.840883 18796 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.842520 18866 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.843343 18180 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.843341 18101 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.846232 18652 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.846361 18000 catalog_manager.cc:5484] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:34.850389 18254 consensus_queue.cc:237] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.851311 18180 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.851316 18652 raft_consensus.cc:1261] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.851624 18796 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.851845 18842 consensus_queue.cc:1035] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.853449 18866 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.853842 18178 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.854493 18652 raft_consensus.cc:2932] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.855085 17988 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d193261354994d2db384d9db69a5b463 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:34.856902 17998 catalog_manager.cc:5484] T d193261354994d2db384d9db69a5b463 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.859611 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet d193261354994d2db384d9db69a5b463 with delete_type TABLET_DATA_TOMBSTONED (TS a7834062bf084f9cabbff4788a79d2a9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55982
I20240501 19:57:34.860092 18883 tablet_replica.cc:330] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: stopping tablet replica
I20240501 19:57:34.860234 18883 raft_consensus.cc:2229] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:34.860383 18883 raft_consensus.cc:2258] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:34.861055 18883 ts_tablet_manager.cc:1875] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:34.863157 18883 ts_tablet_manager.cc:1888] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:34.863236 18883 log.cc:1196] T d193261354994d2db384d9db69a5b463 P a7834062bf084f9cabbff4788a79d2a9: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/wals/d193261354994d2db384d9db69a5b463
I20240501 19:57:34.863680 17987 catalog_manager.cc:4830] TS a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): tablet d193261354994d2db384d9db69a5b463 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:34.946691 18796 raft_consensus.cc:1050] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:34.947155 18796 consensus_queue.cc:237] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.948505 18652 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.948642 18178 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.948642 18101 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.948891 18885 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.949075 18866 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.949258 18842 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.952080 18796 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.952433 18652 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.954227 18178 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.954869 17999 catalog_manager.cc:5484] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.956714 18101 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.959085 18254 consensus_queue.cc:237] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.960173 18652 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.960490 18866 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.961846 18101 raft_consensus.cc:1261] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.961875 18885 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.962222 18842 consensus_queue.cc:1035] T d9f7b594299448a09fa4aefe5af61230 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.962244 18652 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.963029 18102 raft_consensus.cc:2932] T d9f7b594299448a09fa4aefe5af61230 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.963852 17988 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d9f7b594299448a09fa4aefe5af61230 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:34.964779 17998 catalog_manager.cc:5484] T d9f7b594299448a09fa4aefe5af61230 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.967350 18166 tablet_service.cc:1514] Processing DeleteTablet for tablet d9f7b594299448a09fa4aefe5af61230 with delete_type TABLET_DATA_TOMBSTONED (TS d7ebf87da4c94e46a875293608ddad04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34632
I20240501 19:57:34.967779 18889 tablet_replica.cc:330] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: stopping tablet replica
I20240501 19:57:34.967921 18889 raft_consensus.cc:2229] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:34.968062 18889 raft_consensus.cc:2258] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:34.968596 18889 ts_tablet_manager.cc:1875] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:34.970600 18889 ts_tablet_manager.cc:1888] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:34.970688 18889 log.cc:1196] T d9f7b594299448a09fa4aefe5af61230 P d7ebf87da4c94e46a875293608ddad04: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/wals/d9f7b594299448a09fa4aefe5af61230
I20240501 19:57:34.971151 17985 catalog_manager.cc:4830] TS d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): tablet d9f7b594299448a09fa4aefe5af61230 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:34.985302 18872 raft_consensus.cc:1050] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:34.985822 18872 consensus_queue.cc:237] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.987015 18652 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.987231 18254 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.987325 18799 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.987529 18101 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:34.987720 18799 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.987880 18845 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:34.989627 18799 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.990059 18652 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.991724 18254 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.992164 18001 catalog_manager.cc:5484] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:34.992300 18101 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.995397 18178 consensus_queue.cc:237] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:34.996392 18652 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.996457 18254 raft_consensus.cc:1261] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:34.996727 18845 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.997669 18845 consensus_queue.cc:1035] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:34.998281 18872 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.998649 18652 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:34.999616 18254 raft_consensus.cc:2932] T 0a43eb46633f4a25b08b84779c0d64ae P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.000772 17985 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0a43eb46633f4a25b08b84779c0d64ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:35.000924 17999 catalog_manager.cc:5484] T 0a43eb46633f4a25b08b84779c0d64ae P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.003439 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a43eb46633f4a25b08b84779c0d64ae with delete_type TABLET_DATA_TOMBSTONED (TS a7834062bf084f9cabbff4788a79d2a9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55982
I20240501 19:57:35.003631 18883 tablet_replica.cc:330] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: stopping tablet replica
I20240501 19:57:35.003784 18883 raft_consensus.cc:2229] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:35.003902 18883 raft_consensus.cc:2258] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:35.004408 18883 ts_tablet_manager.cc:1875] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:35.006284 18883 ts_tablet_manager.cc:1888] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:35.006363 18883 log.cc:1196] T 0a43eb46633f4a25b08b84779c0d64ae P a7834062bf084f9cabbff4788a79d2a9: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/wals/0a43eb46633f4a25b08b84779c0d64ae
I20240501 19:57:35.006835 17987 catalog_manager.cc:4830] TS a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): tablet 0a43eb46633f4a25b08b84779c0d64ae (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:35.227783 18874 raft_consensus.cc:1050] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:35.228215 18874 consensus_queue.cc:237] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:35.229712 18652 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:35.229810 18254 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:35.230255 18826 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:35.230424 18178 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:35.230607 18826 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:35.231058 18826 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:35.232628 18896 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.233301 18178 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.234990 18253 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.235270 18652 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.237123 18001 catalog_manager.cc:5484] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.240808 18102 consensus_queue.cc:237] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:35.241714 18652 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:35.242110 18874 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:35.242275 18178 raft_consensus.cc:1261] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:35.242741 18896 consensus_queue.cc:1035] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:35.244026 18874 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.244447 18652 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.245347 17987 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 819cf24be08746ab892f903e3119392b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:35.245659 18178 raft_consensus.cc:2932] T 819cf24be08746ab892f903e3119392b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:35.246865 18000 catalog_manager.cc:5484] T 819cf24be08746ab892f903e3119392b P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:35.248870 18242 tablet_service.cc:1514] Processing DeleteTablet for tablet 819cf24be08746ab892f903e3119392b with delete_type TABLET_DATA_TOMBSTONED (TS 030d4bb74d5046d98e41d25d74fce3f5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36150
I20240501 19:57:35.249265 18901 tablet_replica.cc:330] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: stopping tablet replica
I20240501 19:57:35.249508 18901 raft_consensus.cc:2229] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:35.249650 18901 raft_consensus.cc:2258] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:35.250144 18901 ts_tablet_manager.cc:1875] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:35.251916 18901 ts_tablet_manager.cc:1888] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:35.251997 18901 log.cc:1196] T 819cf24be08746ab892f903e3119392b P 030d4bb74d5046d98e41d25d74fce3f5: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/wals/819cf24be08746ab892f903e3119392b
I20240501 19:57:35.252509 17988 catalog_manager.cc:4830] TS 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): tablet 819cf24be08746ab892f903e3119392b (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:36.255753 18180 consensus_queue.cc:237] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.257040 18253 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:36.257055 18101 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:36.257112 18143 consensus_peers.cc:485] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24d8d08f9d9140eba6cbb4e19b589e5a. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:36.257400 18845 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.257596 18906 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.259176 18903 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.259552 18101 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.260936 18253 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.261624 18254 consensus_queue.cc:237] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.262746 17999 catalog_manager.cc:5484] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:36.263604 18180 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:36.263849 18218 consensus_peers.cc:485] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5601fd42b321477ab637142f5d4a196b. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:36.264060 18101 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:36.264449 18910 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.264636 18885 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.266284 18910 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.266739 18180 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.266702 18101 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.269420 18000 catalog_manager.cc:5484] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.269793 18101 consensus_queue.cc:237] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.270979 18180 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:36.271061 18254 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:36.271193 18067 consensus_peers.cc:485] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c426ee194254489c8be8b188642f20c4. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:36.271414 18904 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.271615 18918 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.273769 18904 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.274904 18254 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.276257 17999 catalog_manager.cc:5484] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:36.277700 18180 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.281383 18254 consensus_queue.cc:237] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.282651 18101 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:36.282766 18218 consensus_peers.cc:485] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b73b6624ee0145fdaa68b19890c88211. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:36.282904 18180 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:36.283013 18922 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.283265 18910 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:36.284873 18910 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.285383 18178 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.286922 18101 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:36.287564 17999 catalog_manager.cc:5484] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:36.733678 18925 ts_tablet_manager.cc:902] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:36.734340 18925 tablet_copy_client.cc:308] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.3:42749
I20240501 19:57:36.734709 18265 tablet_copy_service.cc:140] P 030d4bb74d5046d98e41d25d74fce3f5: Received BeginTabletCopySession request for tablet 5601fd42b321477ab637142f5d4a196b from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:36180)
I20240501 19:57:36.734797 18265 tablet_copy_service.cc:161] P 030d4bb74d5046d98e41d25d74fce3f5: Beginning new tablet copy session on tablet 5601fd42b321477ab637142f5d4a196b from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:36180: session id = 0ecba761eea842c18c5f5abf24f9bf68-5601fd42b321477ab637142f5d4a196b
I20240501 19:57:36.735662 18265 tablet_copy_source_session.cc:205] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:36.736449 18925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5601fd42b321477ab637142f5d4a196b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:36.738480 18925 tablet_copy_client.cc:783] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:36.738678 18925 tablet_copy_client.cc:647] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:36.739588 18925 tablet_copy_client.cc:523] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:36.740731 18925 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:36.744074 18925 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:36.744325 18925 tablet_bootstrap.cc:492] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:36.744478 18925 ts_tablet_manager.cc:1367] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240501 19:57:36.744900 18925 raft_consensus.cc:348] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.745034 18925 raft_consensus.cc:729] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:36.745143 18925 consensus_queue.cc:260] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.745527 18925 ts_tablet_manager.cc:1398] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 19:57:36.746551 18265 tablet_copy_service.cc:342] P 030d4bb74d5046d98e41d25d74fce3f5: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-5601fd42b321477ab637142f5d4a196b received from {username='slave'} at 127.0.0.1:36180
I20240501 19:57:36.746621 18265 tablet_copy_service.cc:433] P 030d4bb74d5046d98e41d25d74fce3f5: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-5601fd42b321477ab637142f5d4a196b on tablet 5601fd42b321477ab637142f5d4a196b with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:36.803942 18925 ts_tablet_manager.cc:902] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571)
I20240501 19:57:36.804386 18925 tablet_copy_client.cc:308] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.1:43571
I20240501 19:57:36.804800 18114 tablet_copy_service.cc:140] P a7834062bf084f9cabbff4788a79d2a9: Received BeginTabletCopySession request for tablet c426ee194254489c8be8b188642f20c4 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:56004)
I20240501 19:57:36.804889 18114 tablet_copy_service.cc:161] P a7834062bf084f9cabbff4788a79d2a9: Beginning new tablet copy session on tablet c426ee194254489c8be8b188642f20c4 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:56004: session id = 0ecba761eea842c18c5f5abf24f9bf68-c426ee194254489c8be8b188642f20c4
I20240501 19:57:36.805761 18114 tablet_copy_source_session.cc:205] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:36.806485 18925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c426ee194254489c8be8b188642f20c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:36.808496 18925 tablet_copy_client.cc:783] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:36.808651 18925 tablet_copy_client.cc:647] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:36.809902 18925 tablet_copy_client.cc:523] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:36.810894 18925 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:36.814385 18925 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:36.814589 18925 tablet_bootstrap.cc:492] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:36.814735 18925 ts_tablet_manager.cc:1367] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240501 19:57:36.815141 18925 raft_consensus.cc:348] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.815245 18925 raft_consensus.cc:729] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:36.815315 18925 consensus_queue.cc:260] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.816074 18925 ts_tablet_manager.cc:1398] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240501 19:57:36.816414 18114 tablet_copy_service.cc:342] P a7834062bf084f9cabbff4788a79d2a9: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-c426ee194254489c8be8b188642f20c4 received from {username='slave'} at 127.0.0.1:56004
I20240501 19:57:36.816489 18114 tablet_copy_service.cc:433] P a7834062bf084f9cabbff4788a79d2a9: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-c426ee194254489c8be8b188642f20c4 on tablet c426ee194254489c8be8b188642f20c4 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:36.835340 18925 ts_tablet_manager.cc:902] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
I20240501 19:57:36.836002 18925 tablet_copy_client.cc:308] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.2:34865
I20240501 19:57:36.836416 18190 tablet_copy_service.cc:140] P d7ebf87da4c94e46a875293608ddad04: Received BeginTabletCopySession request for tablet 24d8d08f9d9140eba6cbb4e19b589e5a from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:34674)
I20240501 19:57:36.836485 18190 tablet_copy_service.cc:161] P d7ebf87da4c94e46a875293608ddad04: Beginning new tablet copy session on tablet 24d8d08f9d9140eba6cbb4e19b589e5a from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:34674: session id = 0ecba761eea842c18c5f5abf24f9bf68-24d8d08f9d9140eba6cbb4e19b589e5a
I20240501 19:57:36.837225 18190 tablet_copy_source_session.cc:205] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:36.837854 18925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d8d08f9d9140eba6cbb4e19b589e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:36.839601 18925 tablet_copy_client.cc:783] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:36.839736 18925 tablet_copy_client.cc:647] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:36.840591 18925 tablet_copy_client.cc:523] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:36.841590 18925 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:36.845103 18925 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:36.845322 18925 tablet_bootstrap.cc:492] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:36.845467 18925 ts_tablet_manager.cc:1367] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 19:57:36.845968 18925 raft_consensus.cc:348] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.846101 18925 raft_consensus.cc:729] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:36.846205 18925 consensus_queue.cc:260] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.846498 18925 ts_tablet_manager.cc:1398] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 19:57:36.846992 18190 tablet_copy_service.cc:342] P d7ebf87da4c94e46a875293608ddad04: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-24d8d08f9d9140eba6cbb4e19b589e5a received from {username='slave'} at 127.0.0.1:34674
I20240501 19:57:36.847079 18190 tablet_copy_service.cc:433] P d7ebf87da4c94e46a875293608ddad04: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-24d8d08f9d9140eba6cbb4e19b589e5a on tablet 24d8d08f9d9140eba6cbb4e19b589e5a with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:36.861992 18925 ts_tablet_manager.cc:902] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
I20240501 19:57:36.862448 18925 tablet_copy_client.cc:308] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Beginning tablet copy session from remote peer at address 127.16.155.3:42749
I20240501 19:57:36.862825 18265 tablet_copy_service.cc:140] P 030d4bb74d5046d98e41d25d74fce3f5: Received BeginTabletCopySession request for tablet b73b6624ee0145fdaa68b19890c88211 from peer 0ecba761eea842c18c5f5abf24f9bf68 ({username='slave'} at 127.0.0.1:36180)
I20240501 19:57:36.862910 18265 tablet_copy_service.cc:161] P 030d4bb74d5046d98e41d25d74fce3f5: Beginning new tablet copy session on tablet b73b6624ee0145fdaa68b19890c88211 from peer 0ecba761eea842c18c5f5abf24f9bf68 at {username='slave'} at 127.0.0.1:36180: session id = 0ecba761eea842c18c5f5abf24f9bf68-b73b6624ee0145fdaa68b19890c88211
I20240501 19:57:36.863766 18265 tablet_copy_source_session.cc:205] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 19:57:36.864506 18925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73b6624ee0145fdaa68b19890c88211. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 19:57:36.867401 18925 tablet_copy_client.cc:783] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 0 data blocks...
I20240501 19:57:36.867558 18925 tablet_copy_client.cc:647] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Starting download of 1 WAL segments...
I20240501 19:57:36.868407 18925 tablet_copy_client.cc:523] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 19:57:36.869872 18925 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap starting.
I20240501 19:57:36.872853 18925 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 19:57:36.873106 18925 tablet_bootstrap.cc:492] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Bootstrap complete.
I20240501 19:57:36.873263 18925 ts_tablet_manager.cc:1367] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 19:57:36.873703 18925 raft_consensus.cc:348] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.873832 18925 raft_consensus.cc:729] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0ecba761eea842c18c5f5abf24f9bf68, State: Initialized, Role: LEARNER
I20240501 19:57:36.873936 18925 consensus_queue.cc:260] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:36.874253 18925 ts_tablet_manager.cc:1398] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 19:57:36.874655 18265 tablet_copy_service.cc:342] P 030d4bb74d5046d98e41d25d74fce3f5: Request end of tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-b73b6624ee0145fdaa68b19890c88211 received from {username='slave'} at 127.0.0.1:36180
I20240501 19:57:36.874723 18265 tablet_copy_service.cc:433] P 030d4bb74d5046d98e41d25d74fce3f5: ending tablet copy session 0ecba761eea842c18c5f5abf24f9bf68-b73b6624ee0145fdaa68b19890c88211 on tablet b73b6624ee0145fdaa68b19890c88211 with peer 0ecba761eea842c18c5f5abf24f9bf68
I20240501 19:57:37.297669 18652 raft_consensus.cc:1203] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:37.391029 18652 raft_consensus.cc:1203] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:37.416218 18652 raft_consensus.cc:1203] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:37.467270 18652 raft_consensus.cc:1203] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 19:57:37.821996 18845 raft_consensus.cc:1050] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:37.822489 18845 consensus_queue.cc:237] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.823717 18652 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.823873 18102 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.823962 18254 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.824139 18948 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.824388 18953 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.824703 18948 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.826323 18948 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.827119 18254 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.828369 18652 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.829596 18102 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.830544 17999 catalog_manager.cc:5484] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.836772 18180 consensus_queue.cc:237] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.837836 18102 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.837831 18652 raft_consensus.cc:1261] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.838155 18948 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.838310 18953 consensus_queue.cc:1035] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.839663 18845 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.840126 18652 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.840126 18101 raft_consensus.cc:2932] T 24d8d08f9d9140eba6cbb4e19b589e5a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.841022 17985 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 24d8d08f9d9140eba6cbb4e19b589e5a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:37.842600 18000 catalog_manager.cc:5484] T 24d8d08f9d9140eba6cbb4e19b589e5a P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.845374 18242 tablet_service.cc:1514] Processing DeleteTablet for tablet 24d8d08f9d9140eba6cbb4e19b589e5a with delete_type TABLET_DATA_TOMBSTONED (TS 030d4bb74d5046d98e41d25d74fce3f5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36150
I20240501 19:57:37.845749 18961 tablet_replica.cc:330] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: stopping tablet replica
I20240501 19:57:37.845983 18961 raft_consensus.cc:2229] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:37.846117 18961 raft_consensus.cc:2258] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:37.846621 18961 ts_tablet_manager.cc:1875] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:37.848539 18961 ts_tablet_manager.cc:1888] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:37.848623 18961 log.cc:1196] T 24d8d08f9d9140eba6cbb4e19b589e5a P 030d4bb74d5046d98e41d25d74fce3f5: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/wals/24d8d08f9d9140eba6cbb4e19b589e5a
I20240501 19:57:37.849238 17988 catalog_manager.cc:4830] TS 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): tablet 24d8d08f9d9140eba6cbb4e19b589e5a (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:37.880885 18950 raft_consensus.cc:1050] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:37.881309 18950 consensus_queue.cc:237] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.882642 18652 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.882699 18180 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.882936 18101 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.882968 18950 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.883123 18922 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.883412 18922 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.885725 18950 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.886029 18102 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.887902 18180 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.887949 18652 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.888307 17998 catalog_manager.cc:5484] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:37.891384 18253 consensus_queue.cc:237] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.892542 18101 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.892737 18652 raft_consensus.cc:1261] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.893107 18922 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.893280 18902 consensus_queue.cc:1035] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.894552 18902 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.895874 17988 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5601fd42b321477ab637142f5d4a196b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:37.896021 18102 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.897219 17998 catalog_manager.cc:5484] T 5601fd42b321477ab637142f5d4a196b P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:37.898797 18652 raft_consensus.cc:2932] T 5601fd42b321477ab637142f5d4a196b P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER d7ebf87da4c94e46a875293608ddad04 (127.16.155.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.899528 18166 tablet_service.cc:1514] Processing DeleteTablet for tablet 5601fd42b321477ab637142f5d4a196b with delete_type TABLET_DATA_TOMBSTONED (TS d7ebf87da4c94e46a875293608ddad04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34632
I20240501 19:57:37.899856 18968 tablet_replica.cc:330] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: stopping tablet replica
I20240501 19:57:37.900081 18968 raft_consensus.cc:2229] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:37.900293 18968 raft_consensus.cc:2258] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:37.901857 18968 ts_tablet_manager.cc:1875] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:37.903944 18968 ts_tablet_manager.cc:1888] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:37.904049 18968 log.cc:1196] T 5601fd42b321477ab637142f5d4a196b P d7ebf87da4c94e46a875293608ddad04: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-1-root/wals/5601fd42b321477ab637142f5d4a196b
I20240501 19:57:37.904500 17985 catalog_manager.cc:4830] TS d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865): tablet 5601fd42b321477ab637142f5d4a196b (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:37.948863 18951 raft_consensus.cc:1050] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:37.949363 18951 consensus_queue.cc:237] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.950845 18652 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.950845 18180 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.951300 18971 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.951624 18253 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.951663 18971 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.951997 18971 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.953719 18971 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.954121 18652 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.954731 18253 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.956462 18000 catalog_manager.cc:5484] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.958096 18180 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.961755 18101 consensus_queue.cc:237] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.962791 18180 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.962960 18652 raft_consensus.cc:1261] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.963146 18971 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.963344 18963 raft_consensus.cc:1050] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5: attempting to promote NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 to VOTER
I20240501 19:57:37.963303 18967 consensus_queue.cc:1035] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.963711 18963 consensus_queue.cc:237] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.964946 18102 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.965073 18653 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 LEARNER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.965103 18967 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.965286 18963 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.965516 18902 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.965921 18653 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.966535 17987 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c426ee194254489c8be8b188642f20c4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:37.966673 18178 raft_consensus.cc:2932] T c426ee194254489c8be8b188642f20c4 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.968114 18180 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 19:57:37.968287 18001 catalog_manager.cc:5484] T c426ee194254489c8be8b188642f20c4 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index 3 to 4, VOTER 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3) evicted. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:37.968720 18902 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 19:57:37.970889 18922 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.971254 18180 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.971596 18242 tablet_service.cc:1514] Processing DeleteTablet for tablet c426ee194254489c8be8b188642f20c4 with delete_type TABLET_DATA_TOMBSTONED (TS 030d4bb74d5046d98e41d25d74fce3f5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36150
I20240501 19:57:37.971793 18961 tablet_replica.cc:330] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: stopping tablet replica
I20240501 19:57:37.971930 18961 raft_consensus.cc:2229] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:37.972039 18961 raft_consensus.cc:2258] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:37.972546 18961 ts_tablet_manager.cc:1875] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:37.973065 18102 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.973696 18652 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.974593 18961 ts_tablet_manager.cc:1888] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:37.974673 18961 log.cc:1196] T c426ee194254489c8be8b188642f20c4 P 030d4bb74d5046d98e41d25d74fce3f5: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-2-root/wals/c426ee194254489c8be8b188642f20c4
I20240501 19:57:37.975769 17998 catalog_manager.cc:5484] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 reported cstate change: config changed from index 2 to 3, 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.977617 17988 catalog_manager.cc:4830] TS 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749): tablet c426ee194254489c8be8b188642f20c4 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:37.979348 18254 consensus_queue.cc:237] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } }
I20240501 19:57:37.980304 18652 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.980580 18180 raft_consensus.cc:1261] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 19:57:37.980624 18963 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.980849 18902 consensus_queue.cc:1035] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 19:57:37.982666 18950 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.983101 18178 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.983541 18652 raft_consensus.cc:2932] T b73b6624ee0145fdaa68b19890c88211 P 0ecba761eea842c18c5f5abf24f9bf68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } } }
I20240501 19:57:37.984892 17988 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b73b6624ee0145fdaa68b19890c88211 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 19:57:37.985620 18001 catalog_manager.cc:5484] T b73b6624ee0145fdaa68b19890c88211 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index 3 to 4, VOTER a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1) evicted. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 19:57:37.987988 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet b73b6624ee0145fdaa68b19890c88211 with delete_type TABLET_DATA_TOMBSTONED (TS a7834062bf084f9cabbff4788a79d2a9 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55982
I20240501 19:57:37.988318 18979 tablet_replica.cc:330] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: stopping tablet replica
I20240501 19:57:37.988471 18979 raft_consensus.cc:2229] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 19:57:37.988616 18979 raft_consensus.cc:2258] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 19:57:37.989104 18979 ts_tablet_manager.cc:1875] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 19:57:37.991031 18979 ts_tablet_manager.cc:1888] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 19:57:37.991117 18979 log.cc:1196] T b73b6624ee0145fdaa68b19890c88211 P a7834062bf084f9cabbff4788a79d2a9: Deleting WAL directory at /tmp/dist-test-taskipO3yG/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714593394928573-17004-0/minicluster-data/ts-0-root/wals/b73b6624ee0145fdaa68b19890c88211
I20240501 19:57:37.991619 17987 catalog_manager.cc:4830] TS a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571): tablet b73b6624ee0145fdaa68b19890c88211 (table test-workload [id=685bf390c4b34454876285d28e7825ff]) successfully deleted
I20240501 19:57:38.995818 18254 consensus_queue.cc:237] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:38.997180 18102 raft_consensus.cc:1261] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:38.997196 18218 consensus_peers.cc:485] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35f0b0466c85499ba02a5ac1d3af8637. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:38.997179 18178 raft_consensus.cc:1261] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:38.997666 18922 consensus_queue.cc:1035] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:38.997856 18982 consensus_queue.cc:1035] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:38.999538 18963 raft_consensus.cc:2932] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:38.999908 18178 raft_consensus.cc:2932] T 35f0b0466c85499ba02a5ac1d3af8637 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.000950 18102 raft_consensus.cc:2932] T 35f0b0466c85499ba02a5ac1d3af8637 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.002296 17998 catalog_manager.cc:5484] T 35f0b0466c85499ba02a5ac1d3af8637 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:39.004246 18178 consensus_queue.cc:237] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:39.005618 18254 raft_consensus.cc:1261] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:39.005959 18102 raft_consensus.cc:1261] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer d7ebf87da4c94e46a875293608ddad04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 19:57:39.006376 18143 consensus_peers.cc:485] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 818d68581b324da38ffec03581cb3c12. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:39.006494 18980 consensus_queue.cc:1035] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:39.007284 18990 consensus_queue.cc:1035] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:39.008219 18980 raft_consensus.cc:2932] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.009256 18254 raft_consensus.cc:2932] T 818d68581b324da38ffec03581cb3c12 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.009989 18101 raft_consensus.cc:2932] T 818d68581b324da38ffec03581cb3c12 P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.012307 18001 catalog_manager.cc:5484] T 818d68581b324da38ffec03581cb3c12 P d7ebf87da4c94e46a875293608ddad04 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "d7ebf87da4c94e46a875293608ddad04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:39.012706 18101 consensus_queue.cc:237] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:39.014374 18178 raft_consensus.cc:1261] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:39.014868 18971 consensus_queue.cc:1035] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 19:57:39.015038 18067 consensus_peers.cc:485] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0329a5653d944689bd539e54b2531c32. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:39.015275 18254 raft_consensus.cc:1261] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Refusing update from remote peer a7834062bf084f9cabbff4788a79d2a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:39.015594 18971 consensus_queue.cc:1035] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:39.017112 18994 raft_consensus.cc:2932] T 0329a5653d944689bd539e54b2531c32 P a7834062bf084f9cabbff4788a79d2a9 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.017501 18178 raft_consensus.cc:2932] T 0329a5653d944689bd539e54b2531c32 P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.017612 18254 raft_consensus.cc:2932] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.019904 18254 consensus_queue.cc:237] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } }
I20240501 19:57:39.019948 17998 catalog_manager.cc:5484] T 0329a5653d944689bd539e54b2531c32 P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "a7834062bf084f9cabbff4788a79d2a9" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } attrs { replace: true } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
W20240501 19:57:39.021034 18218 consensus_peers.cc:485] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 -> Peer 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4:44927): Couldn't send request to peer 0ecba761eea842c18c5f5abf24f9bf68. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c666aa80bd648f3b2857a2f19d6b26a. This is attempt 1: this message will repeat every 5th retry.
I20240501 19:57:39.021072 18102 raft_consensus.cc:1261] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:39.021422 18178 raft_consensus.cc:1261] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Refusing update from remote peer 030d4bb74d5046d98e41d25d74fce3f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 19:57:39.021454 18982 consensus_queue.cc:1035] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:39.021770 18963 consensus_queue.cc:1035] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 19:57:39.023787 18982 raft_consensus.cc:2932] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.024269 18178 raft_consensus.cc:2932] T 6c666aa80bd648f3b2857a2f19d6b26a P d7ebf87da4c94e46a875293608ddad04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.024447 18102 raft_consensus.cc:2932] T 6c666aa80bd648f3b2857a2f19d6b26a P a7834062bf084f9cabbff4788a79d2a9 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } } }
I20240501 19:57:39.026329 18000 catalog_manager.cc:5484] T 6c666aa80bd648f3b2857a2f19d6b26a P 030d4bb74d5046d98e41d25d74fce3f5 reported cstate change: config changed from index -1 to 2, NON_VOTER 0ecba761eea842c18c5f5abf24f9bf68 (127.16.155.4) added. New cstate: current_term: 1 leader_uuid: "030d4bb74d5046d98e41d25d74fce3f5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a7834062bf084f9cabbff4788a79d2a9" member_type: VOTER last_known_addr { host: "127.16.155.1" port: 43571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7ebf87da4c94e46a875293608ddad04" member_type: VOTER last_known_addr { host: "127.16.155.2" port: 34865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "030d4bb74d5046d98e41d25d74fce3f5" member_type: VOTER last_known_addr { host: "127.16.155.3" port: 42749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ecba761eea842c18c5f5abf24f9bf68" member_type: NON_VOTER last_known_addr { host: "127.16.155.4" port: 44927 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 19:57:39.444445 19001 ts_tablet_manager.cc:902] T 35f0b0466c85499ba02a5ac1d3af8637 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
F20240501 19:57:39.444689 19001 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.queue_time_us, tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.queue_time_us) (tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.run_cpu_time_us, tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.run_cpu_time_us) (tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.run_wall_time_us, tablet-download-pool-0a43eb46633f4a25b08b84779c0d64ae.run_wall_time_us) (tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.queue_time_us, tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.queue_time_us) (tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.run_cpu_time_us, tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.run_cpu_time_us) (tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.run_wall_time_us, tablet-download-pool-24d8d08f9d9140eba6cbb4e19b589e5a.run_wall_time_us) (tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.queue_time_us, tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.queue_time_us) (tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.run_cpu_time_us, tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.run_cpu_time_us) (tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.run_wall_time_us, tablet-download-pool-2cfee7a6c48e487f84b2dd8c708314cd.run_wall_time_us) (tablet-download-pool-357676875d3b4ce190161065f07c507f.queue_time_us, tablet-download-pool-357676875d3b4ce190161065f07c507f.queue_time_us) (tablet-download-pool-357676875d3b4ce190161065f07c507f.run_cpu_time_us, tablet-download-pool-357676875d3b4ce190161065f07c507f.run_cpu_time_us) (tablet-download-pool-357676875d3b4ce190161065f07c507f.run_wall_time_us, tablet-download-pool-357676875d3b4ce190161065f07c507f.run_wall_time_us) (tablet-download-pool-35f0b0466c85499ba02a5ac1d3af8637.queue_time_us, tablet-download-pool-35f0b0466c85499ba02a5ac1d3af8637.queue_time_us) (tablet-download-pool-5601fd42b321477ab637142f5d4a196b.queue_time_us, tablet-download-pool-5601fd42b321477ab637142f5d4a196b.queue_time_us) (tablet-download-pool-5601fd42b321477ab637142f5d4a196b.run_cpu_time_us, tablet-download-pool-5601fd42b321477ab637142f5d4a196b.run_cpu_time_us) (tablet-download-pool-5601fd42b321477ab637142f5d4a196b.run_wall_time_us, tablet-download-pool-5601fd42b321477ab637142f5d4a196b.run_wall_time_us) (tablet-download-pool-819cf24be08746ab892f903e3119392b.queue_time_us, tablet-download-pool-819cf24be08746ab892f903e3119392b.queue_time_us) (tablet-download-pool-819cf24be08746ab892f903e3119392b.run_cpu_time_us, tablet-download-pool-819cf24be08746ab892f903e3119392b.run_cpu_time_us) (tablet-download-pool-819cf24be08746ab892f903e3119392b.run_wall_time_us, tablet-download-pool-819cf24be08746ab892f903e3119392b.run_wall_time_us) (tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.queue_time_us, tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.queue_time_us) (tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.run_cpu_time_us, tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.run_cpu_time_us) (tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.run_wall_time_us, tablet-download-pool-9ae71a6ccffe4c1f908ccae0efba2841.run_wall_time_us) (tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.queue_time_us, tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.queue_time_us) (tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.run_cpu_time_us, tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.run_cpu_time_us) (tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.run_wall_time_us, tablet-download-pool-b73b6624ee0145fdaa68b19890c88211.run_wall_time_us) (tablet-download-pool-c426ee194254489c8be8b188642f20c4.queue_time_us, tablet-download-pool-c426ee194254489c8be8b188642f20c4.queue_time_us) (tablet-download-pool-c426ee194254489c8be8b188642f20c4.run_cpu_time_us, tablet-download-pool-c426ee194254489c8be8b188642f20c4.run_cpu_time_us) (tablet-download-pool-c426ee194254489c8be8b188642f20c4.run_wall_time_us, tablet-download-pool-c426ee194254489c8be8b188642f20c4.run_wall_time_us) (tablet-download-pool-d193261354994d2db384d9db69a5b463.queue_time_us, tablet-download-pool-d193261354994d2db384d9db69a5b463.queue_time_us) (tablet-download-pool-d193261354994d2db384d9db69a5b463.run_cpu_time_us, tablet-download-pool-d193261354994d2db384d9db69a5b463.run_cpu_time_us) (tablet-download-pool-d193261354994d2db384d9db69a5b463.run_wall_time_us, tablet-download-pool-d193261354994d2db384d9db69a5b463.run_wall_time_us) (tablet-download-pool-d20a351a6427444e96bfc1828a990e92.queue_time_us, tablet-download-pool-d20a351a6427444e96bfc1828a990e92.queue_time_us) (tablet-download-pool-d20a351a6427444e96bfc1828a990e92.run_cpu_time_us, tablet-download-pool-d20a351a6427444e96bfc1828a990e92.run_cpu_time_us) (tablet-download-pool-d20a351a6427444e96bfc1828a990e92.run_wall_time_us, tablet-download-pool-d20a351a6427444e96bfc1828a990e92.run_wall_time_us) (tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.queue_time_us, tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.queue_time_us) (tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.run_cpu_time_us, tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.run_cpu_time_us) (tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.run_wall_time_us, tablet-download-pool-d9f7b594299448a09fa4aefe5af61230.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714593459 (unix time) try "date -d @1714593459" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e80000426c) received by PID 17004 (TID 0x7ff34b813700) from PID 17004; stack trace: ***
@ 0x7ff3ef13b980 (unknown) at ??:0
@ 0x7ff3ecc0bfb7 gsignal at ??:0
@ 0x7ff3ecc0d921 abort at ??:0
@ 0x7ff3ede16dcd google::LogMessage::Fail() at ??:0
@ 0x7ff3ede1ab93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff3ede167cc google::LogMessage::Flush() at ??:0
@ 0x7ff3ede17f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff3ee96e044 kudu::TraceMetrics::InternName() at ??:0
@ 0x7ff3ee952f98 kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7ff3ee950efc kudu::ThreadPoolBuilder::Build() at ??:0
I20240501 19:57:39.495203 19012 ts_tablet_manager.cc:902] T 0329a5653d944689bd539e54b2531c32 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer a7834062bf084f9cabbff4788a79d2a9 (127.16.155.1:43571)
@ 0x7ff3efa5677a kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7ff3efa5fa45 kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7ff3efae076f kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7ff3efaf44f6 kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7ff3efadf226 _ZZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS_6StatusENS0_24TabletServerErrorPB_CodeEEEENKUlvE_clEv at ??:0
I20240501 19:57:39.514364 19018 ts_tablet_manager.cc:902] T 6c666aa80bd648f3b2857a2f19d6b26a P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer 030d4bb74d5046d98e41d25d74fce3f5 (127.16.155.3:42749)
@ 0x7ff3efaeec0a _ZNSt17_Function_handlerIFvvEZN4kudu7tserver15TSTabletManager15StartTabletCopyEPKNS1_9consensus24StartTabletCopyRequestPBESt8functionIFvRKNS1_6StatusENS2_24TabletServerErrorPB_CodeEEEEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20240501 19:57:39.518193 19020 ts_tablet_manager.cc:902] T 818d68581b324da38ffec03581cb3c12 P 0ecba761eea842c18c5f5abf24f9bf68: Initiating tablet copy from peer d7ebf87da4c94e46a875293608ddad04 (127.16.155.2:34865)
@ 0x7ff3f00493cc std::function<>::operator()() at ??:0
@ 0x7ff3ee955e06 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff3ee9566ef _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7ff3ee95803b _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff3f00493cc std::function<>::operator()() at ??:0
@ 0x7ff3ee945807 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff3ef1306db start_thread at ??:0
@ 0x7ff3eccee71f clone at ??:0