[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240501 08:10:40.745596 26326 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.181.190:45383
I20240501 08:10:40.747341 26326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240501 08:10:40.748761 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:10:40.761368 26331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:10:40.762133 26332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:10:40.762810 26334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:40.763790 26326 server_base.cc:1034] running on GCE node
I20240501 08:10:40.764693 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:10:40.764873 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:10:40.764979 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551040764961 us; error 0 us; skew 500 ppm
I20240501 08:10:40.765355 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:10:40.772162 26326 webserver.cc:460] Webserver started at http://127.25.181.190:35903/ using document root <none> and password file <none>
I20240501 08:10:40.773052 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:10:40.773164 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:10:40.773556 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:10:40.777572 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/master-0-root/instance:
uuid: "3025c56aaec746889336bfd8ba02081d"
format_stamp: "Formatted at 2024-05-01 08:10:40 on dist-test-slave-4f6n"
I20240501 08:10:40.784281 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20240501 08:10:40.787909 26339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:40.789520 26326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:10:40.789709 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/master-0-root
uuid: "3025c56aaec746889336bfd8ba02081d"
format_stamp: "Formatted at 2024-05-01 08:10:40 on dist-test-slave-4f6n"
I20240501 08:10:40.789896 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:10:40.804850 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:10:40.805755 26326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240501 08:10:40.806063 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:10:40.827734 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.190:45383
I20240501 08:10:40.827764 26390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.190:45383 every 8 connection(s)
I20240501 08:10:40.832605 26391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:40.846469 26391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: Bootstrap starting.
I20240501 08:10:40.850504 26391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:40.851825 26391 log.cc:824] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: Log is configured to *not* fsync() on all Append() calls
I20240501 08:10:40.854830 26391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: No bootstrap required, opened a new log
I20240501 08:10:40.862437 26391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER }
I20240501 08:10:40.862812 26391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:40.862900 26391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3025c56aaec746889336bfd8ba02081d, State: Initialized, Role: FOLLOWER
I20240501 08:10:40.863787 26391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER }
I20240501 08:10:40.864032 26391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:10:40.864197 26391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:10:40.864385 26391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:40.866600 26391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER }
I20240501 08:10:40.867224 26391 leader_election.cc:302] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3025c56aaec746889336bfd8ba02081d; no voters:
I20240501 08:10:40.868021 26391 leader_election.cc:288] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:10:40.868180 26394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:40.868860 26394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 1 LEADER]: Becoming Leader. State: Replica: 3025c56aaec746889336bfd8ba02081d, State: Running, Role: LEADER
I20240501 08:10:40.869541 26394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER }
I20240501 08:10:40.870304 26391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:10:40.873015 26396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3025c56aaec746889336bfd8ba02081d. Latest consensus state: current_term: 1 leader_uuid: "3025c56aaec746889336bfd8ba02081d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER } }
I20240501 08:10:40.872931 26395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3025c56aaec746889336bfd8ba02081d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3025c56aaec746889336bfd8ba02081d" member_type: VOTER } }
I20240501 08:10:40.873383 26396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [sys.catalog]: This master's current role is: LEADER
I20240501 08:10:40.873391 26395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [sys.catalog]: This master's current role is: LEADER
I20240501 08:10:40.879739 26403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:10:40.886737 26403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:10:40.887528 26326 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 08:10:40.896850 26403 catalog_manager.cc:1347] Generated new cluster ID: 2e0aa5c82e7e4a83a87f249d7bbc4c35
I20240501 08:10:40.896991 26403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:10:40.916955 26403 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:10:40.918846 26403 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:10:40.939949 26403 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: Generated new TSK 0
I20240501 08:10:40.941315 26403 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:10:40.953903 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:10:40.959636 26413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:10:40.960444 26414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:10:40.961028 26416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:40.963086 26326 server_base.cc:1034] running on GCE node
I20240501 08:10:40.963598 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:10:40.963769 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:10:40.963876 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551040963851 us; error 0 us; skew 500 ppm
I20240501 08:10:40.964159 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:10:40.966034 26326 webserver.cc:460] Webserver started at http://127.25.181.129:43983/ using document root <none> and password file <none>
I20240501 08:10:40.966472 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:10:40.966617 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:10:40.966835 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:10:40.967885 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-0-root/instance:
uuid: "a8ab803e6faa4aab834acec7360ebb21"
format_stamp: "Formatted at 2024-05-01 08:10:40 on dist-test-slave-4f6n"
I20240501 08:10:40.972362 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20240501 08:10:40.975303 26421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:40.975872 26326 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:10:40.976035 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
uuid: "a8ab803e6faa4aab834acec7360ebb21"
format_stamp: "Formatted at 2024-05-01 08:10:40 on dist-test-slave-4f6n"
I20240501 08:10:40.976204 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:10:40.998454 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:10:40.999449 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:10:41.000512 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:10:41.002453 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:10:41.002630 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.002759 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:10:41.002846 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.022905 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.129:33629
I20240501 08:10:41.022927 26483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.129:33629 every 8 connection(s)
I20240501 08:10:41.025467 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:10:41.041121 26487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:10:41.042768 26489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:41.055003 26484 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45383
I20240501 08:10:41.055572 26484 heartbeater.cc:464] Registering TS with master...
I20240501 08:10:41.056037 26326 server_base.cc:1034] running on GCE node
I20240501 08:10:41.056591 26484 heartbeater.cc:511] Master 127.25.181.190:45383 requested a full tablet report, sending...
W20240501 08:10:41.056838 26491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:41.057292 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:10:41.057379 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:10:41.057479 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551041057431 us; error 0 us; skew 500 ppm
I20240501 08:10:41.057675 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:10:41.059892 26356 ts_manager.cc:194] Registered new tserver with Master: a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629)
I20240501 08:10:41.060554 26326 webserver.cc:460] Webserver started at http://127.25.181.130:41717/ using document root <none> and password file <none>
I20240501 08:10:41.060833 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:10:41.060951 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:10:41.061100 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:10:41.061817 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-1-root/instance:
uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
format_stamp: "Formatted at 2024-05-01 08:10:41 on dist-test-slave-4f6n"
I20240501 08:10:41.062486 26356 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36814
I20240501 08:10:41.065068 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:10:41.067050 26496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.067517 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 08:10:41.067636 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
format_stamp: "Formatted at 2024-05-01 08:10:41 on dist-test-slave-4f6n"
I20240501 08:10:41.067824 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:10:41.080447 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:10:41.081210 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:10:41.081955 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:10:41.083068 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:10:41.083143 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.083321 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:10:41.083391 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20240501 08:10:41.110680 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.130:39229
I20240501 08:10:41.110716 26558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.130:39229 every 8 connection(s)
I20240501 08:10:41.113009 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:10:41.116731 26562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:41.126036 26559 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45383
I20240501 08:10:41.126194 26559 heartbeater.cc:464] Registering TS with master...
W20240501 08:10:41.126770 26565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:41.126973 26559 heartbeater.cc:511] Master 127.25.181.190:45383 requested a full tablet report, sending...
W20240501 08:10:41.127640 26563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:10:41.127784 26326 server_base.cc:1034] running on GCE node
I20240501 08:10:41.128217 26356 ts_manager.cc:194] Registered new tserver with Master: 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:41.129017 26356 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36824
I20240501 08:10:41.131644 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:10:41.131747 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:10:41.131819 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551041131790 us; error 0 us; skew 500 ppm
I20240501 08:10:41.131999 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:10:41.133560 26326 webserver.cc:460] Webserver started at http://127.25.181.131:38171/ using document root <none> and password file <none>
I20240501 08:10:41.133828 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:10:41.133917 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:10:41.134089 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:10:41.134841 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-2-root/instance:
uuid: "7aa79ac63b854bc7994896637a914f62"
format_stamp: "Formatted at 2024-05-01 08:10:41 on dist-test-slave-4f6n"
I20240501 08:10:41.137782 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240501 08:10:41.139758 26570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.140194 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 08:10:41.140341 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
uuid: "7aa79ac63b854bc7994896637a914f62"
format_stamp: "Formatted at 2024-05-01 08:10:41 on dist-test-slave-4f6n"
I20240501 08:10:41.140475 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714551040672050-26326-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:10:41.148428 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:10:41.149145 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:10:41.149883 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:10:41.150918 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:10:41.151002 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.151113 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:10:41.151196 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:10:41.172979 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.131:41375
I20240501 08:10:41.173012 26632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.131:41375 every 8 connection(s)
I20240501 08:10:41.182287 26633 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45383
I20240501 08:10:41.182452 26633 heartbeater.cc:464] Registering TS with master...
I20240501 08:10:41.182965 26633 heartbeater.cc:511] Master 127.25.181.190:45383 requested a full tablet report, sending...
I20240501 08:10:41.183895 26356 ts_manager.cc:194] Registered new tserver with Master: 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.184561 26326 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01035904s
I20240501 08:10:41.184692 26356 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36830
I20240501 08:10:41.186283 26326 test_util.cc:268] Using random seed: 96623045
I20240501 08:10:41.211984 26356 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36842:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 08:10:41.214550 26356 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 08:10:41.285388 26598 tablet_service.cc:1467] Processing CreateTablet for tablet 66ee272d343b46f58f04c5962dfadffa (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 08:10:41.285588 26594 tablet_service.cc:1467] Processing CreateTablet for tablet df9f6410bbdb4687a638bd22a5fd7c93 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 08:10:41.285732 26593 tablet_service.cc:1467] Processing CreateTablet for tablet 38338ee9cf0f4e7f89f568c0a0369e5b (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 08:10:41.285786 26595 tablet_service.cc:1467] Processing CreateTablet for tablet 036f7fe4dd8c492bac5ccfaaa72c9124 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 08:10:41.285970 26596 tablet_service.cc:1467] Processing CreateTablet for tablet 85d6d06fac2f47759cff9c01989a53a7 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 08:10:41.285315 26597 tablet_service.cc:1467] Processing CreateTablet for tablet e6b1d8dfae61449d9fd5d0ed2f27c668 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 08:10:41.286428 26594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9f6410bbdb4687a638bd22a5fd7c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.286696 26597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b1d8dfae61449d9fd5d0ed2f27c668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.286952 26593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38338ee9cf0f4e7f89f568c0a0369e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.287369 26595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036f7fe4dd8c492bac5ccfaaa72c9124. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.288722 26596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d6d06fac2f47759cff9c01989a53a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.291584 26598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66ee272d343b46f58f04c5962dfadffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.293305 26592 tablet_service.cc:1467] Processing CreateTablet for tablet 818e3ab66b874857b3542484aa3c17f5 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 08:10:41.296262 26592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e3ab66b874857b3542484aa3c17f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.296257 26591 tablet_service.cc:1467] Processing CreateTablet for tablet cd202ed3ff104e738f2b427fb88cb9d4 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 08:10:41.299156 26591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd202ed3ff104e738f2b427fb88cb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.299108 26590 tablet_service.cc:1467] Processing CreateTablet for tablet 56c8a479965c49f5ade08d8628767254 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 08:10:41.301735 26590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c8a479965c49f5ade08d8628767254. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.308122 26449 tablet_service.cc:1467] Processing CreateTablet for tablet 66ee272d343b46f58f04c5962dfadffa (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 08:10:41.310910 26448 tablet_service.cc:1467] Processing CreateTablet for tablet e6b1d8dfae61449d9fd5d0ed2f27c668 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 08:10:41.313143 26446 tablet_service.cc:1467] Processing CreateTablet for tablet 036f7fe4dd8c492bac5ccfaaa72c9124 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 08:10:41.316591 26449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66ee272d343b46f58f04c5962dfadffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.317857 26448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b1d8dfae61449d9fd5d0ed2f27c668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.320923 26446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036f7fe4dd8c492bac5ccfaaa72c9124. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.323379 26444 tablet_service.cc:1467] Processing CreateTablet for tablet 38338ee9cf0f4e7f89f568c0a0369e5b (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 08:10:41.324105 26444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38338ee9cf0f4e7f89f568c0a0369e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.324558 26443 tablet_service.cc:1467] Processing CreateTablet for tablet 818e3ab66b874857b3542484aa3c17f5 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 08:10:41.325237 26443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e3ab66b874857b3542484aa3c17f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.325819 26442 tablet_service.cc:1467] Processing CreateTablet for tablet cd202ed3ff104e738f2b427fb88cb9d4 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 08:10:41.326434 26442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd202ed3ff104e738f2b427fb88cb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.322417 26447 tablet_service.cc:1467] Processing CreateTablet for tablet 85d6d06fac2f47759cff9c01989a53a7 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 08:10:41.320376 26445 tablet_service.cc:1467] Processing CreateTablet for tablet df9f6410bbdb4687a638bd22a5fd7c93 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 08:10:41.327406 26441 tablet_service.cc:1467] Processing CreateTablet for tablet 56c8a479965c49f5ade08d8628767254 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 08:10:41.333849 26447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d6d06fac2f47759cff9c01989a53a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.335681 26441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c8a479965c49f5ade08d8628767254. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.339233 26445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9f6410bbdb4687a638bd22a5fd7c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.343200 26522 tablet_service.cc:1467] Processing CreateTablet for tablet 85d6d06fac2f47759cff9c01989a53a7 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240501 08:10:41.344606 26523 tablet_service.cc:1467] Processing CreateTablet for tablet e6b1d8dfae61449d9fd5d0ed2f27c668 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240501 08:10:41.344847 26524 tablet_service.cc:1467] Processing CreateTablet for tablet 66ee272d343b46f58f04c5962dfadffa (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240501 08:10:41.344930 26521 tablet_service.cc:1467] Processing CreateTablet for tablet 036f7fe4dd8c492bac5ccfaaa72c9124 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240501 08:10:41.344743 26520 tablet_service.cc:1467] Processing CreateTablet for tablet df9f6410bbdb4687a638bd22a5fd7c93 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240501 08:10:41.349278 26522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85d6d06fac2f47759cff9c01989a53a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.350787 26519 tablet_service.cc:1467] Processing CreateTablet for tablet 38338ee9cf0f4e7f89f568c0a0369e5b (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240501 08:10:41.355882 26523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b1d8dfae61449d9fd5d0ed2f27c668. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.355850 26517 tablet_service.cc:1467] Processing CreateTablet for tablet cd202ed3ff104e738f2b427fb88cb9d4 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240501 08:10:41.360502 26518 tablet_service.cc:1467] Processing CreateTablet for tablet 818e3ab66b874857b3542484aa3c17f5 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240501 08:10:41.362767 26648 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.363180 26521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036f7fe4dd8c492bac5ccfaaa72c9124. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.362468 26516 tablet_service.cc:1467] Processing CreateTablet for tablet 56c8a479965c49f5ade08d8628767254 (DEFAULT_TABLE table=test-workload [id=5d5ea5164b8a4d519fe8ecdcf023f323]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240501 08:10:41.372121 26518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818e3ab66b874857b3542484aa3c17f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.374574 26520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df9f6410bbdb4687a638bd22a5fd7c93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.377813 26516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56c8a479965c49f5ade08d8628767254. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.379004 26517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd202ed3ff104e738f2b427fb88cb9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.382130 26524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66ee272d343b46f58f04c5962dfadffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.384533 26519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 38338ee9cf0f4e7f89f568c0a0369e5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:10:41.403792 26649 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.419472 26648 tablet_bootstrap.cc:654] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.436064 26650 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.436996 26649 tablet_bootstrap.cc:654] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.441115 26650 tablet_bootstrap.cc:654] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.442057 26648 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.442273 26648 ts_tablet_manager.cc:1367] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.089s user 0.007s sys 0.008s
I20240501 08:10:41.443625 26648 raft_consensus.cc:348] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.443926 26648 raft_consensus.cc:374] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.443989 26650 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.444053 26648 raft_consensus.cc:729] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.444131 26650 ts_tablet_manager.cc:1367] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20240501 08:10:41.444366 26648 consensus_queue.cc:260] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.445025 26650 raft_consensus.cc:348] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.445237 26650 raft_consensus.cc:374] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.445310 26648 ts_tablet_manager.cc:1398] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 08:10:41.445449 26650 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.445899 26649 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.446036 26649 ts_tablet_manager.cc:1367] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.000s
I20240501 08:10:41.445819 26650 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.446835 26650 ts_tablet_manager.cc:1398] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20240501 08:10:41.446918 26649 raft_consensus.cc:348] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.447077 26559 heartbeater.cc:503] Master 127.25.181.190:45383 was elected leader, sending a full tablet report...
I20240501 08:10:41.447129 26649 raft_consensus.cc:374] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.447233 26649 raft_consensus.cc:729] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.447302 26650 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.447501 26649 consensus_queue.cc:260] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.449235 26650 tablet_bootstrap.cc:654] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.455478 26633 heartbeater.cc:503] Master 127.25.181.190:45383 was elected leader, sending a full tablet report...
I20240501 08:10:41.462663 26648 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.467567 26648 tablet_bootstrap.cc:654] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.476999 26650 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.477558 26648 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.477774 26650 ts_tablet_manager.cc:1367] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.030s user 0.007s sys 0.021s
I20240501 08:10:41.477782 26648 ts_tablet_manager.cc:1367] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.008s
I20240501 08:10:41.478699 26654 raft_consensus.cc:482] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.478919 26648 raft_consensus.cc:348] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.478859 26650 raft_consensus.cc:348] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.478984 26654 raft_consensus.cc:504] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.479240 26650 raft_consensus.cc:374] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.479236 26648 raft_consensus.cc:374] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.479533 26650 raft_consensus.cc:729] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.479586 26648 raft_consensus.cc:729] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.479821 26649 ts_tablet_manager.cc:1398] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.034s user 0.012s sys 0.022s
I20240501 08:10:41.480103 26484 heartbeater.cc:503] Master 127.25.181.190:45383 was elected leader, sending a full tablet report...
I20240501 08:10:41.480177 26649 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.480031 26648 consensus_queue.cc:260] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.479851 26650 consensus_queue.cc:260] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.481292 26654 leader_election.cc:288] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:41.481676 26650 ts_tablet_manager.cc:1398] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 08:10:41.481966 26650 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.482096 26649 tablet_bootstrap.cc:654] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.483896 26650 tablet_bootstrap.cc:654] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.493661 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
W20240501 08:10:41.495438 26572 leader_election.cc:341] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.518417 26649 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.518659 26649 ts_tablet_manager.cc:1367] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.005s
I20240501 08:10:41.519623 26649 raft_consensus.cc:348] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.520156 26649 raft_consensus.cc:374] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.520277 26649 raft_consensus.cc:729] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.520581 26649 consensus_queue.cc:260] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.521210 26649 ts_tablet_manager.cc:1398] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:10:41.521423 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
I20240501 08:10:41.521925 26534 raft_consensus.cc:2454] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 0.
I20240501 08:10:41.522827 26574 leader_election.cc:302] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters: a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.523355 26654 raft_consensus.cc:2781] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.523537 26649 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.523490 26654 raft_consensus.cc:482] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.523644 26654 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:10:41.525678 26485 tablet.cc:2369] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 08:10:41.526847 26648 ts_tablet_manager.cc:1398] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.049s user 0.001s sys 0.009s
I20240501 08:10:41.529837 26648 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.529843 26654 raft_consensus.cc:504] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.531332 26654 leader_election.cc:288] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:41.531770 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
W20240501 08:10:41.532650 26572 leader_election.cc:341] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.533373 26648 tablet_bootstrap.cc:654] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.533629 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:41.534004 26534 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.539703 26649 tablet_bootstrap.cc:654] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.545441 26650 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.545713 26650 ts_tablet_manager.cc:1367] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.064s user 0.038s sys 0.021s
I20240501 08:10:41.546937 26649 tablet_bootstrap.cc:492] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.547109 26649 ts_tablet_manager.cc:1367] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.004s
I20240501 08:10:41.546993 26650 raft_consensus.cc:348] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.547318 26650 raft_consensus.cc:374] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.547470 26650 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.547853 26650 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.548017 26649 raft_consensus.cc:348] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.548389 26649 raft_consensus.cc:374] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.548517 26650 ts_tablet_manager.cc:1398] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240501 08:10:41.548899 26650 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.550525 26534 raft_consensus.cc:2454] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 1.
I20240501 08:10:41.550829 26650 tablet_bootstrap.cc:654] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.550981 26574 leader_election.cc:302] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters: a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.551470 26654 raft_consensus.cc:2781] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.551640 26654 raft_consensus.cc:686] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:41.551966 26654 consensus_queue.cc:237] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.552254 26649 raft_consensus.cc:729] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.552557 26649 consensus_queue.cc:260] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.553143 26649 ts_tablet_manager.cc:1398] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:10:41.554198 26649 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.554481 26656 raft_consensus.cc:482] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.554644 26656 raft_consensus.cc:504] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.557566 26649 tablet_bootstrap.cc:654] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.566992 26656 leader_election.cc:288] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.570024 26648 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.571141 26648 ts_tablet_manager.cc:1367] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.044s user 0.004s sys 0.003s
I20240501 08:10:41.572764 26648 raft_consensus.cc:348] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.575783 26648 raft_consensus.cc:374] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.576452 26648 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.577369 26648 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.580965 26648 ts_tablet_manager.cc:1398] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 08:10:41.585265 26648 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.581568 26356 catalog_manager.cc:5484] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:41.580338 26649 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.585804 26649 ts_tablet_manager.cc:1367] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.010s
I20240501 08:10:41.586928 26649 raft_consensus.cc:348] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.587889 26649 raft_consensus.cc:374] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.588080 26649 raft_consensus.cc:729] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.587388 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.589056 26608 raft_consensus.cc:2454] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 0.
I20240501 08:10:41.590462 26424 leader_election.cc:302] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.590978 26649 consensus_queue.cc:260] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.591476 26656 raft_consensus.cc:2781] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.591825 26656 raft_consensus.cc:482] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.591876 26650 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.591961 26656 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.595129 26650 ts_tablet_manager.cc:1367] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.043s user 0.013s sys 0.013s
I20240501 08:10:41.595546 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
W20240501 08:10:41.596781 26425 leader_election.cc:341] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.596776 26656 raft_consensus.cc:504] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.597658 26648 tablet_bootstrap.cc:654] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.597959 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
W20240501 08:10:41.598485 26425 leader_election.cc:341] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.598980 26656 leader_election.cc:288] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.599889 26650 raft_consensus.cc:348] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.600741 26650 raft_consensus.cc:374] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.600929 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.603602 26650 raft_consensus.cc:729] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.603703 26608 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.604048 26650 consensus_queue.cc:260] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.604789 26650 ts_tablet_manager.cc:1398] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 08:10:41.605715 26650 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.607352 26608 raft_consensus.cc:2454] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 1.
I20240501 08:10:41.607632 26650 tablet_bootstrap.cc:654] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.607782 26424 leader_election.cc:302] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters: 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:41.608178 26670 raft_consensus.cc:2781] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.601022 26649 ts_tablet_manager.cc:1398] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.015s user 0.003s sys 0.007s
I20240501 08:10:41.608660 26649 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.608763 26670 raft_consensus.cc:686] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:41.609184 26670 consensus_queue.cc:237] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.610440 26649 tablet_bootstrap.cc:654] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.610702 26648 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.611307 26648 ts_tablet_manager.cc:1367] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.006s
I20240501 08:10:41.625357 26656 raft_consensus.cc:482] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.625624 26656 raft_consensus.cc:504] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.626971 26656 leader_election.cc:288] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.627353 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.627241 26648 raft_consensus.cc:348] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.627657 26648 raft_consensus.cc:374] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.627754 26648 raft_consensus.cc:729] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.627373 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
I20240501 08:10:41.628742 26534 raft_consensus.cc:2379] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a8ab803e6faa4aab834acec7360ebb21 in current term 1: Already voted for candidate 7aa79ac63b854bc7994896637a914f62 in this term.
I20240501 08:10:41.629340 26425 leader_election.cc:302] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8ab803e6faa4aab834acec7360ebb21; no voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:41.629910 26656 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.628113 26648 consensus_queue.cc:260] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.633491 26648 ts_tablet_manager.cc:1398] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.022s user 0.001s sys 0.002s
I20240501 08:10:41.634018 26648 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.634881 26649 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.635052 26649 ts_tablet_manager.cc:1367] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.000s
I20240501 08:10:41.635995 26649 raft_consensus.cc:348] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.636269 26649 raft_consensus.cc:374] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.636377 26649 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.636716 26648 tablet_bootstrap.cc:654] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.636636 26649 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.642127 26650 tablet_bootstrap.cc:492] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.644078 26650 ts_tablet_manager.cc:1367] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.001s
I20240501 08:10:41.644673 26354 catalog_manager.cc:5484] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.645371 26650 raft_consensus.cc:348] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.645632 26650 raft_consensus.cc:374] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.645762 26650 raft_consensus.cc:729] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.646037 26650 consensus_queue.cc:260] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.646634 26650 ts_tablet_manager.cc:1398] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:10:41.646795 26648 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.646948 26650 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.646950 26648 ts_tablet_manager.cc:1367] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.002s
I20240501 08:10:41.647879 26648 raft_consensus.cc:348] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.648103 26648 raft_consensus.cc:374] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.648197 26648 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.648445 26648 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.649138 26648 ts_tablet_manager.cc:1398] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:10:41.649426 26648 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.651171 26648 tablet_bootstrap.cc:654] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.652601 26650 tablet_bootstrap.cc:654] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.656718 26656 raft_consensus.cc:2726] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:10:41.657339 26650 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.657527 26650 ts_tablet_manager.cc:1367] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240501 08:10:41.658200 26650 raft_consensus.cc:348] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.658416 26650 raft_consensus.cc:374] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.658524 26650 raft_consensus.cc:729] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.658805 26650 consensus_queue.cc:260] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.660866 26648 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.661073 26648 ts_tablet_manager.cc:1367] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20240501 08:10:41.661103 26649 ts_tablet_manager.cc:1398] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.026s user 0.007s sys 0.007s
I20240501 08:10:41.661486 26649 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.661933 26648 raft_consensus.cc:348] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.662173 26648 raft_consensus.cc:374] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.662262 26648 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.662573 26648 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.663158 26648 ts_tablet_manager.cc:1398] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:10:41.663476 26648 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.663926 26649 tablet_bootstrap.cc:654] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.665158 26648 tablet_bootstrap.cc:654] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.665328 26650 ts_tablet_manager.cc:1398] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240501 08:10:41.665629 26650 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.666997 26655 raft_consensus.cc:482] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.667331 26650 tablet_bootstrap.cc:654] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.667147 26655 raft_consensus.cc:504] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.672049 26655 leader_election.cc:288] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.697110 26649 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.697389 26649 ts_tablet_manager.cc:1367] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.036s user 0.015s sys 0.015s
I20240501 08:10:41.698350 26649 raft_consensus.cc:348] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.698648 26649 raft_consensus.cc:374] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.698737 26649 raft_consensus.cc:729] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.699061 26649 consensus_queue.cc:260] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.699803 26649 ts_tablet_manager.cc:1398] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:10:41.700142 26649 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.702085 26649 tablet_bootstrap.cc:654] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.706764 26648 tablet_bootstrap.cc:492] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.706935 26648 ts_tablet_manager.cc:1367] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.044s user 0.015s sys 0.026s
I20240501 08:10:41.707808 26648 raft_consensus.cc:348] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.708031 26648 raft_consensus.cc:374] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.708130 26648 raft_consensus.cc:729] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.708398 26648 consensus_queue.cc:260] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.709105 26648 ts_tablet_manager.cc:1398] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:10:41.709565 26648 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.710327 26649 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.710477 26649 ts_tablet_manager.cc:1367] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240501 08:10:41.711381 26649 raft_consensus.cc:348] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.711571 26648 tablet_bootstrap.cc:654] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.711598 26649 raft_consensus.cc:374] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.711652 26654 raft_consensus.cc:482] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.711719 26649 raft_consensus.cc:729] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.711813 26654 raft_consensus.cc:504] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.711972 26650 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.712122 26650 ts_tablet_manager.cc:1367] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.008s
I20240501 08:10:41.712127 26649 consensus_queue.cc:260] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.712474 26675 raft_consensus.cc:482] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.712517 26654 leader_election.cc:288] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:41.712610 26675 raft_consensus.cc:504] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.713011 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.713200 26459 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 0.
I20240501 08:10:41.713438 26675 leader_election.cc:288] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.713697 26572 leader_election.cc:302] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.713692 26650 raft_consensus.cc:348] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.713893 26650 raft_consensus.cc:374] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.713989 26650 raft_consensus.cc:729] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.714038 26649 ts_tablet_manager.cc:1398] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240501 08:10:41.714381 26649 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.714231 26650 consensus_queue.cc:260] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.714524 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
I20240501 08:10:41.714730 26534 raft_consensus.cc:2454] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 0.
I20240501 08:10:41.714958 26650 ts_tablet_manager.cc:1398] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:10:41.715387 26650 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.716192 26649 tablet_bootstrap.cc:654] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.717756 26650 tablet_bootstrap.cc:654] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.717677 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.718920 26425 leader_election.cc:302] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.719265 26675 raft_consensus.cc:2781] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.719424 26675 raft_consensus.cc:482] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.719521 26675 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:10:41.719614 26424 leader_election.cc:341] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.720585 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
I20240501 08:10:41.720805 26534 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 0.
I20240501 08:10:41.721199 26654 raft_consensus.cc:2781] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.721300 26654 raft_consensus.cc:482] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.721421 26654 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.722733 26675 raft_consensus.cc:504] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.719271 26655 raft_consensus.cc:482] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.723457 26655 raft_consensus.cc:504] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.723975 26655 leader_election.cc:288] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.724264 26675 leader_election.cc:288] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.724995 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
W20240501 08:10:41.725886 26424 leader_election.cc:341] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.726009 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:41.726200 26534 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.727417 26654 raft_consensus.cc:504] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.729367 26534 raft_consensus.cc:2454] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 1.
I20240501 08:10:41.732126 26425 leader_election.cc:302] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters: 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:41.732416 26675 raft_consensus.cc:2781] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.732581 26675 raft_consensus.cc:686] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:41.732579 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:41.732792 26459 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.732822 26654 leader_election.cc:288] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:41.732945 26675 consensus_queue.cc:237] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.735314 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:41.735621 26534 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.736903 26459 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 1.
I20240501 08:10:41.737289 26572 leader_election.cc:302] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.730120 26648 tablet_bootstrap.cc:492] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.737634 26654 raft_consensus.cc:2781] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.737725 26648 ts_tablet_manager.cc:1367] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.011s
I20240501 08:10:41.738305 26654 raft_consensus.cc:686] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:41.738677 26648 raft_consensus.cc:348] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.738909 26648 raft_consensus.cc:374] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.738983 26648 raft_consensus.cc:729] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.738791 26654 consensus_queue.cc:237] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.739221 26648 consensus_queue.cc:260] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.734397 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e3ab66b874857b3542484aa3c17f5" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.734436 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.740023 26458 raft_consensus.cc:2454] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 0.
W20240501 08:10:41.740505 26498 leader_election.cc:341] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.740762 26498 leader_election.cc:302] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.740914 26650 tablet_bootstrap.cc:492] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.741037 26655 raft_consensus.cc:2781] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.741096 26650 ts_tablet_manager.cc:1367] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.004s
I20240501 08:10:41.741147 26655 raft_consensus.cc:482] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.741287 26655 raft_consensus.cc:3037] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.741356 26649 tablet_bootstrap.cc:492] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.741555 26649 ts_tablet_manager.cc:1367] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.004s
I20240501 08:10:41.742013 26650 raft_consensus.cc:348] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.742269 26650 raft_consensus.cc:374] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.742358 26650 raft_consensus.cc:729] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.742434 26649 raft_consensus.cc:348] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.742677 26649 raft_consensus.cc:374] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.742594 26650 consensus_queue.cc:260] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.742784 26649 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.743014 26649 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.743553 26649 ts_tablet_manager.cc:1398] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:10:41.743849 26649 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: Bootstrap starting.
I20240501 08:10:41.744235 26534 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 1.
I20240501 08:10:41.744932 26655 raft_consensus.cc:504] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.745455 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e3ab66b874857b3542484aa3c17f5" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.745699 26608 raft_consensus.cc:2454] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 0.
I20240501 08:10:41.745803 26649 tablet_bootstrap.cc:654] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.745923 26655 leader_election.cc:288] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.746819 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e3ab66b874857b3542484aa3c17f5" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:41.746999 26458 raft_consensus.cc:3037] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.750209 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.750552 26608 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 0.
I20240501 08:10:41.750721 26458 raft_consensus.cc:2454] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.750924 26656 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.751130 26656 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.751330 26498 leader_election.cc:302] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.751677 26655 raft_consensus.cc:2781] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.751830 26655 raft_consensus.cc:686] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:41.752059 26656 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.752156 26655 consensus_queue.cc:237] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.752848 26649 tablet_bootstrap.cc:492] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: No bootstrap required, opened a new log
I20240501 08:10:41.753024 26649 ts_tablet_manager.cc:1367] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s
I20240501 08:10:41.753290 26648 ts_tablet_manager.cc:1398] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240501 08:10:41.753418 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.753633 26608 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 0.
I20240501 08:10:41.753693 26648 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: Bootstrap starting.
I20240501 08:10:41.753952 26649 raft_consensus.cc:348] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.754195 26424 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.754667 26656 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.754803 26656 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.754942 26656 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.754194 26649 raft_consensus.cc:374] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.756273 26649 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.756526 26649 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.757284 26649 ts_tablet_manager.cc:1398] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240501 08:10:41.758025 26656 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.758661 26352 catalog_manager.cc:5484] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.759171 26648 tablet_bootstrap.cc:654] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.759275 26533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
W20240501 08:10:41.762123 26425 leader_election.cc:341] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.762534 26650 ts_tablet_manager.cc:1398] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.021s user 0.008s sys 0.004s
I20240501 08:10:41.763006 26650 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Bootstrap starting.
I20240501 08:10:41.763176 26356 catalog_manager.cc:5484] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 1 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.766228 26650 tablet_bootstrap.cc:654] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Neither blocks nor log segments found. Creating new log.
I20240501 08:10:41.768828 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.769085 26608 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.769604 26690 raft_consensus.cc:482] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.769872 26690 raft_consensus.cc:504] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.770512 26656 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.770910 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
W20240501 08:10:41.771730 26425 leader_election.cc:341] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:10:41.772154 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.772078 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818e3ab66b874857b3542484aa3c17f5" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.772584 26607 raft_consensus.cc:3037] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.772428 26606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.772835 26606 raft_consensus.cc:2379] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in current term 1: Already voted for candidate a8ab803e6faa4aab834acec7360ebb21 in this term.
I20240501 08:10:41.772787 26608 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 1.
I20240501 08:10:41.771224 26690 leader_election.cc:288] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.774955 26607 raft_consensus.cc:2454] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.775452 26424 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters: 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:41.772145 26499 leader_election.cc:302] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters: a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.776103 26690 raft_consensus.cc:2781] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.776127 26656 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.776312 26690 raft_consensus.cc:482] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.776623 26656 raft_consensus.cc:686] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:41.777304 26690 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.777683 26656 consensus_queue.cc:237] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.776901 26499 leader_election.cc:302] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c; no voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.779781 26655 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.781323 26690 raft_consensus.cc:504] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.782047 26690 leader_election.cc:288] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.782680 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:41.782805 26655 raft_consensus.cc:2726] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:10:41.782928 26458 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.783843 26650 tablet_bootstrap.cc:492] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: No bootstrap required, opened a new log
I20240501 08:10:41.783895 26648 tablet_bootstrap.cc:492] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: No bootstrap required, opened a new log
I20240501 08:10:41.784114 26648 ts_tablet_manager.cc:1367] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: Time spent bootstrapping tablet: real 0.031s user 0.020s sys 0.003s
I20240501 08:10:41.784135 26650 ts_tablet_manager.cc:1367] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.000s
I20240501 08:10:41.785115 26650 raft_consensus.cc:348] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.785162 26648 raft_consensus.cc:348] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.785439 26648 raft_consensus.cc:374] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.785583 26648 raft_consensus.cc:729] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.785475 26650 raft_consensus.cc:374] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:10:41.785852 26650 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Initialized, Role: FOLLOWER
I20240501 08:10:41.785840 26648 consensus_queue.cc:260] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.786391 26648 ts_tablet_manager.cc:1398] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:10:41.786309 26650 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.786971 26650 ts_tablet_manager.cc:1398] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:10:41.785885 26458 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.787809 26498 leader_election.cc:302] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.787707 26356 catalog_manager.cc:5484] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:41.788700 26655 raft_consensus.cc:2781] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.788846 26655 raft_consensus.cc:686] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:41.789130 26655 consensus_queue.cc:237] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.790217 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.790427 26607 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.793071 26607 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.796224 26354 catalog_manager.cc:5484] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.801208 26354 catalog_manager.cc:5484] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 1 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.837558 26655 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.837818 26655 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.838488 26655 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.839054 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.839051 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.839313 26607 raft_consensus.cc:2379] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in current term 1: Already voted for candidate a8ab803e6faa4aab834acec7360ebb21 in this term.
I20240501 08:10:41.839722 26499 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c; no voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.840009 26655 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.841979 26655 raft_consensus.cc:2726] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240501 08:10:41.879829 26402 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 08:10:41.882651 26655 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.882874 26655 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.883570 26655 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.884128 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21" is_pre_election: true
I20240501 08:10:41.884186 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.884451 26607 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 0.
I20240501 08:10:41.884454 26458 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 0.
I20240501 08:10:41.884944 26498 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.885192 26655 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.885313 26655 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.885406 26655 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.887459 26655 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.888049 26655 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.888525 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:41.888545 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.888734 26458 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.888741 26607 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.890805 26607 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.890825 26458 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 1.
I20240501 08:10:41.891232 26498 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.891549 26655 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.891670 26655 raft_consensus.cc:686] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:41.891942 26655 consensus_queue.cc:237] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.894495 26354 catalog_manager.cc:5484] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 1 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.956151 26656 raft_consensus.cc:482] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:10:41.956393 26656 raft_consensus.cc:504] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.957118 26656 leader_election.cc:288] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.957635 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62" is_pre_election: true
I20240501 08:10:41.957643 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" is_pre_election: true
I20240501 08:10:41.957859 26534 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 0.
I20240501 08:10:41.957864 26607 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 0.
I20240501 08:10:41.958240 26425 leader_election.cc:302] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.958494 26656 raft_consensus.cc:2781] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:10:41.958611 26656 raft_consensus.cc:482] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:10:41.958701 26656 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.960657 26656 raft_consensus.cc:504] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.961308 26656 leader_election.cc:288] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:41.961848 26534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:41.961843 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:41.962091 26534 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.962167 26607 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:41.964237 26607 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 1.
I20240501 08:10:41.964525 26534 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 1.
I20240501 08:10:41.964681 26424 leader_election.cc:302] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:41.964984 26656 raft_consensus.cc:2781] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:10:41.965137 26656 raft_consensus.cc:686] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:41.965428 26656 consensus_queue.cc:237] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:41.968317 26354 catalog_manager.cc:5484] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:41.997330 26534 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:48906
I20240501 08:10:41.997648 26534 raft_consensus.cc:595] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Received request to transfer leadership to TS a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:41.999855 26534 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:48906
I20240501 08:10:42.000043 26534 raft_consensus.cc:595] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Received request to transfer leadership to TS a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:42.006532 26607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:37654
I20240501 08:10:42.006713 26607 raft_consensus.cc:595] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:42.008894 26607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:37654
I20240501 08:10:42.009063 26607 raft_consensus.cc:595] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:42.016664 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:33994
I20240501 08:10:42.016911 26458 raft_consensus.cc:595] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:42.019243 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "56c8a479965c49f5ade08d8628767254"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:33994
I20240501 08:10:42.019518 26458 raft_consensus.cc:595] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Received request to transfer leadership to TS 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:42.087723 26656 consensus_queue.cc:1035] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.093037 26675 consensus_queue.cc:1035] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.115001 26607 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:10:42.117828 26675 consensus_queue.cc:1035] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.120918 26656 raft_consensus.cc:979] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:42.121104 26656 raft_consensus.cc:1067] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Signalling peer 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:42.121582 26654 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.122414 26607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "56c8a479965c49f5ade08d8628767254"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:37632
I20240501 08:10:42.122715 26607 raft_consensus.cc:482] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.122890 26607 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.125247 26656 consensus_queue.cc:1035] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.125595 26654 raft_consensus.cc:979] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.125751 26654 raft_consensus.cc:1067] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.128093 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48894
I20240501 08:10:42.128389 26532 raft_consensus.cc:482] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.128546 26532 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.129658 26659 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.130928 26607 raft_consensus.cc:504] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.131776 26607 leader_election.cc:288] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:42.131840 26532 raft_consensus.cc:504] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.132138 26457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:42.132138 26533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56c8a479965c49f5ade08d8628767254" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:42.132391 26457 raft_consensus.cc:3032] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.132499 26457 raft_consensus.cc:729] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:42.132882 26457 consensus_queue.cc:260] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.133335 26457 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.133603 26459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:42.134708 26532 leader_election.cc:288] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:42.135151 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:42.135401 26607 raft_consensus.cc:3032] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.135531 26607 raft_consensus.cc:729] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:42.135840 26607 consensus_queue.cc:260] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.136219 26457 raft_consensus.cc:2454] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 2.
I20240501 08:10:42.136288 26607 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.136745 26572 leader_election.cc:302] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters: 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:42.137053 26659 raft_consensus.cc:2781] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.137209 26659 raft_consensus.cc:686] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 2 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:42.137521 26659 consensus_queue.cc:237] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.140182 26356 catalog_manager.cc:5484] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 1 to 2, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 2 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:42.141937 26607 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:42.142541 26499 leader_election.cc:302] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters: a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:42.142910 26655 raft_consensus.cc:2781] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.143079 26655 raft_consensus.cc:686] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:42.143394 26655 consensus_queue.cc:237] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.148947 26354 catalog_manager.cc:5484] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 1 to 2, leader changed from 7aa79ac63b854bc7994896637a914f62 (127.25.181.131) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 2 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:42.157021 26654 consensus_queue.cc:1035] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.162034 26711 consensus_queue.cc:1035] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.165074 26659 raft_consensus.cc:979] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.165272 26659 raft_consensus.cc:1067] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.165977 26534 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48894
I20240501 08:10:42.166198 26534 raft_consensus.cc:482] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.166338 26534 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.168890 26534 raft_consensus.cc:504] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.169443 26534 leader_election.cc:288] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:42.169853 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:42.170001 26607 raft_consensus.cc:3032] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.170092 26607 raft_consensus.cc:729] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:42.170320 26607 consensus_queue.cc:260] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.170610 26607 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.171797 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38338ee9cf0f4e7f89f568c0a0369e5b" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:42.172010 26458 raft_consensus.cc:3037] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.173391 26607 raft_consensus.cc:2454] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:42.173839 26499 leader_election.cc:302] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters:
I20240501 08:10:42.174193 26690 raft_consensus.cc:2781] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.174343 26690 raft_consensus.cc:686] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:42.174587 26690 consensus_queue.cc:237] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.174723 26458 raft_consensus.cc:2454] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:42.177003 26354 catalog_manager.cc:5484] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 1 to 2, leader changed from 7aa79ac63b854bc7994896637a914f62 (127.25.181.131) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 2 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:42.232880 26656 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.235534 26675 raft_consensus.cc:979] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.235759 26675 raft_consensus.cc:1067] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:42.236332 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48904
I20240501 08:10:42.237035 26532 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.237165 26532 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.237911 26675 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.239931 26532 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.240681 26532 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:42.241258 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:42.241456 26458 raft_consensus.cc:3032] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.241418 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:42.241571 26458 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:42.241837 26458 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.242199 26458 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.245021 26458 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:42.245456 26498 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters: 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:42.245808 26690 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.245956 26690 raft_consensus.cc:686] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:42.246217 26690 consensus_queue.cc:237] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.248107 26356 catalog_manager.cc:5484] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 1 to 2, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 2 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:42.250586 26690 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.254812 26716 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.257442 26655 raft_consensus.cc:979] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:42.257601 26655 raft_consensus.cc:1067] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Signalling peer a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:42.258267 26458 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:33980
I20240501 08:10:42.258431 26458 raft_consensus.cc:482] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.258574 26458 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.260582 26458 raft_consensus.cc:504] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.261145 26458 leader_election.cc:288] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 2 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:42.261608 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:42.261688 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:42.261781 26532 raft_consensus.cc:3032] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.261885 26532 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:42.261914 26607 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.262154 26532 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.262601 26532 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.264283 26607 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 2.
I20240501 08:10:42.264616 26424 leader_election.cc:302] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:42.264854 26532 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 2.
I20240501 08:10:42.264900 26675 raft_consensus.cc:2781] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.265025 26675 raft_consensus.cc:686] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:42.265321 26675 consensus_queue.cc:237] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.267537 26354 catalog_manager.cc:5484] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 1 to 2, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 2 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:42.270702 26655 consensus_queue.cc:1035] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.275867 26716 consensus_queue.cc:1035] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.407137 26716 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.409615 26655 raft_consensus.cc:979] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:42.409816 26655 raft_consensus.cc:1067] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Signalling peer a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:42.410634 26457 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:33980
I20240501 08:10:42.410971 26457 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:42.411134 26457 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.411710 26716 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.414220 26457 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.414777 26458 raft_consensus.cc:1226] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Rejecting Update request from peer 3a2a7d6d7ada44df89dcc51d4e655b2c for earlier term 1. Current term is 2. Ops: []
I20240501 08:10:42.415488 26457 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 2 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:42.415644 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:42.416074 26716 consensus_queue.cc:1046] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.416340 26716 raft_consensus.cc:3032] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:42.416446 26716 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:42.416587 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:42.416757 26716 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.417167 26716 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.421725 26532 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 2.
I20240501 08:10:42.422318 26425 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters: 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:42.422592 26675 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:42.422748 26675 raft_consensus.cc:686] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:42.422967 26675 consensus_queue.cc:237] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:42.424950 26356 catalog_manager.cc:5484] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 1 to 2, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 2 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:42.486717 26675 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.491611 26656 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:10:42.570595 26608 raft_consensus.cc:1261] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.571265 26716 consensus_queue.cc:1035] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.573102 26457 raft_consensus.cc:1261] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.573817 26711 consensus_queue.cc:1035] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.574398 26457 raft_consensus.cc:1261] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.574956 26690 consensus_queue.cc:1035] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.578317 26532 raft_consensus.cc:3037] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.581321 26532 raft_consensus.cc:1261] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.581805 26654 consensus_queue.cc:1035] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.609586 26458 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.611802 26458 raft_consensus.cc:1261] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.612447 26690 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.615543 26608 raft_consensus.cc:1261] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.616072 26655 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.660866 26458 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.661468 26655 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.664340 26608 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.667032 26608 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.667536 26690 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.787813 26608 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.788398 26656 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.791465 26532 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.792357 26675 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.906304 26532 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.906950 26675 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:42.910070 26608 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:42.913084 26608 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:42.913616 26675 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:45.031644 26326 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240501 08:10:45.032088 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:45.040896 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:34006
I20240501 08:10:45.041168 26458 raft_consensus.cc:595] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Received request to transfer leadership to TS 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:45.047839 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:45.048053 26532 raft_consensus.cc:595] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Received request to transfer leadership to TS 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:45.048568 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 08:10:45.048866 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:45.267772 26690 raft_consensus.cc:979] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:45.267969 26690 raft_consensus.cc:1067] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Signalling peer 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:45.268800 26608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:37648
I20240501 08:10:45.269057 26608 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:45.269244 26608 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.271694 26608 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.272473 26608 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:45.273133 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:45.273102 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:45.273423 26532 raft_consensus.cc:3032] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:10:45.273433 26458 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.273617 26532 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:45.273974 26532 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.274464 26532 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.276942 26458 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:45.277521 26572 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:45.277592 26532 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:45.277936 26725 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:10:45.278517 26725 raft_consensus.cc:686] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:45.278888 26725 consensus_queue.cc:237] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.281800 26354 catalog_manager.cc:5484] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 2 to 3, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 3 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:45.546700 26729 raft_consensus.cc:979] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:45.546875 26729 raft_consensus.cc:1067] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Signalling peer 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:45.547750 26608 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:37632
I20240501 08:10:45.548082 26608 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:45.548247 26608 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.553329 26608 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.554397 26608 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:45.554890 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:45.555011 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:45.555140 26458 raft_consensus.cc:3032] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:10:45.555150 26532 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.555330 26458 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:45.555631 26458 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.556047 26458 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:45.558450 26532 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:45.558913 26458 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:45.559046 26574 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters:
I20240501 08:10:45.559399 26725 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:10:45.559589 26725 raft_consensus.cc:686] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:45.559877 26725 consensus_queue.cc:237] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:45.563597 26354 catalog_manager.cc:5484] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 2 to 3, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 3 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:45.655995 26532 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:45.656657 26725 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:45.660634 26458 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:45.661299 26725 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:46.034530 26532 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:46.035208 26725 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:46.038636 26458 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:46.039232 26731 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:46.054517 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:46.056143 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:46.056367 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:47.056810 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:47.058429 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:47.058621 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:48.059118 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:48.061008 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:48.061240 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:49.061720 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:49.063347 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:49.063509 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:50.064000 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:50.065641 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:50.065845 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:51.066248 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:51.067891 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:51.068120 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:52.068593 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:52.070389 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:52.070621 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:53.071156 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:53.073012 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:53.073232 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:54.073704 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:54.075374 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:54.075573 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:55.086619 26326 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240501 08:10:55.088382 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:33994
I20240501 08:10:55.088613 26458 raft_consensus.cc:595] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:55.090606 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:33994
I20240501 08:10:55.090781 26458 raft_consensus.cc:595] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:55.092665 26458 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:33994
I20240501 08:10:55.092840 26458 raft_consensus.cc:595] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:55.094857 26607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:37654
I20240501 08:10:55.095140 26607 raft_consensus.cc:595] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:55.100486 26607 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
mode: GRACEFUL
new_leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:37654
I20240501 08:10:55.100719 26607 raft_consensus.cc:595] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Received request to transfer leadership to TS 3a2a7d6d7ada44df89dcc51d4e655b2c
I20240501 08:10:55.250941 26750 raft_consensus.cc:979] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.251214 26750 raft_consensus.cc:1067] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.252106 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48894
I20240501 08:10:55.252362 26532 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:55.252488 26532 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.254626 26532 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.255421 26532 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 4 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:55.255923 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:55.255923 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:55.256217 26458 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.256225 26607 raft_consensus.cc:3032] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:10:55.256350 26607 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:55.256656 26607 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.257166 26607 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.259338 26725 raft_consensus.cc:979] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.259584 26458 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 4.
I20240501 08:10:55.259717 26725 raft_consensus.cc:1067] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.260308 26498 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:55.260375 26607 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 4.
I20240501 08:10:55.260720 26746 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:10:55.260849 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48894
I20240501 08:10:55.261126 26532 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:55.261252 26532 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.260907 26746 raft_consensus.cc:686] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:55.261607 26746 consensus_queue.cc:237] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.263439 26532 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.264048 26532 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 4 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:55.264427 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:55.264482 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:55.264770 26458 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.264791 26607 raft_consensus.cc:3032] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:10:55.264931 26607 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:55.264868 26356 catalog_manager.cc:5484] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 3 to 4, leader changed from 7aa79ac63b854bc7994896637a914f62 (127.25.181.131) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 4 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:55.265218 26607 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.265586 26607 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:55.267534 26458 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 4.
I20240501 08:10:55.268116 26498 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:55.268425 26746 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:10:55.268488 26607 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 4.
I20240501 08:10:55.268620 26746 raft_consensus.cc:686] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:55.268944 26746 consensus_queue.cc:237] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.272578 26356 catalog_manager.cc:5484] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 3 to 4, leader changed from 7aa79ac63b854bc7994896637a914f62 (127.25.181.131) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 4 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:55.398438 26748 raft_consensus.cc:979] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.398603 26748 raft_consensus.cc:1067] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.399155 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48904
I20240501 08:10:55.399389 26532 raft_consensus.cc:482] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:55.399494 26532 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:55.401460 26532 raft_consensus.cc:504] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.402056 26532 leader_election.cc:288] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 3 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:55.402498 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:55.402532 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:55.402652 26458 raft_consensus.cc:3032] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:10:55.402755 26458 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:55.402801 26607 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:55.403005 26458 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.403347 26458 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:55.404955 26607 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 3.
I20240501 08:10:55.405318 26499 leader_election.cc:302] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters:
I20240501 08:10:55.405359 26458 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 3.
I20240501 08:10:55.405608 26749 raft_consensus.cc:2781] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:10:55.405747 26749 raft_consensus.cc:686] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:55.405974 26749 consensus_queue.cc:237] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.408421 26356 catalog_manager.cc:5484] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 2 to 3, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 3 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:55.434094 26757 raft_consensus.cc:979] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.434270 26757 raft_consensus.cc:1067] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.434949 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48904
I20240501 08:10:55.435122 26532 raft_consensus.cc:482] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:55.435217 26532 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.437095 26532 raft_consensus.cc:504] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.437665 26532 leader_election.cc:288] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:55.438236 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:55.438216 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:55.438462 26607 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.438472 26458 raft_consensus.cc:3032] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:55.438603 26458 raft_consensus.cc:729] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:55.438906 26458 consensus_queue.cc:260] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.439391 26458 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.441691 26607 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:55.442137 26458 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:55.442198 26499 leader_election.cc:302] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters:
I20240501 08:10:55.442476 26749 raft_consensus.cc:2781] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:55.442667 26749 raft_consensus.cc:686] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:55.442919 26749 consensus_queue.cc:237] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.445672 26356 catalog_manager.cc:5484] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 1 to 2, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 2 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:55.664415 26748 raft_consensus.cc:979] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: : Instructing follower 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.664583 26748 raft_consensus.cc:1067] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Signalling peer 3a2a7d6d7ada44df89dcc51d4e655b2c to start an election
I20240501 08:10:55.665179 26532 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
from {username='slave'} at 127.0.0.1:48904
I20240501 08:10:55.665386 26532 raft_consensus.cc:482] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:55.665477 26532 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.667459 26532 raft_consensus.cc:504] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.668051 26532 leader_election.cc:288] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:55.668574 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:55.668619 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b1d8dfae61449d9fd5d0ed2f27c668" candidate_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:55.668767 26607 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.668831 26458 raft_consensus.cc:3032] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:10:55.668967 26458 raft_consensus.cc:729] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:55.669250 26458 consensus_queue.cc:260] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.669669 26458 raft_consensus.cc:3037] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:10:55.671131 26607 raft_consensus.cc:2454] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:55.671572 26499 leader_election.cc:302] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, 7aa79ac63b854bc7994896637a914f62; no voters:
I20240501 08:10:55.671852 26749 raft_consensus.cc:2781] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:10:55.672044 26749 raft_consensus.cc:686] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Leader. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:55.672096 26458 raft_consensus.cc:2454] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a2a7d6d7ada44df89dcc51d4e655b2c in term 2.
I20240501 08:10:55.672418 26749 consensus_queue.cc:237] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:55.675134 26356 catalog_manager.cc:5484] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c reported cstate change: term changed from 1 to 2, leader changed from a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129) to 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130). New cstate: current_term: 2 leader_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:55.708065 26458 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:55.708703 26746 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:55.713516 26607 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:55.714311 26764 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:55.781914 26458 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:55.782656 26749 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:55.785979 26607 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:55.786589 26746 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:55.813694 26607 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:55.814419 26746 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:55.818570 26458 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:55.819186 26746 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:55.910652 26458 raft_consensus.cc:1261] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:55.911410 26746 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:55.915259 26607 raft_consensus.cc:1261] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:55.916224 26746 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:56.068585 26458 raft_consensus.cc:1261] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:56.069123 26772 consensus_queue.cc:1035] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:56.072510 26607 raft_consensus.cc:1261] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Refusing update from remote peer 3a2a7d6d7ada44df89dcc51d4e655b2c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:10:56.073251 26746 consensus_queue.cc:1035] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:10:58.112442 26326 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240501 08:10:58.112713 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:58.115109 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:58.115373 26532 raft_consensus.cc:595] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Received request to transfer leadership to TS 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:58.116274 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:58.116456 26532 raft_consensus.cc:595] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Received request to transfer leadership to TS a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:58.117319 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:58.117480 26532 raft_consensus.cc:595] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 LEADER]: Received request to transfer leadership to TS a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:58.118315 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:58.118468 26532 raft_consensus.cc:595] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Received request to transfer leadership to TS a8ab803e6faa4aab834acec7360ebb21
I20240501 08:10:58.119335 26532 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93"
dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
mode: GRACEFUL
new_leader_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:48920
I20240501 08:10:58.119484 26532 raft_consensus.cc:595] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Received request to transfer leadership to TS 7aa79ac63b854bc7994896637a914f62
I20240501 08:10:58.119825 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240501 08:10:58.120033 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:10:58.142692 26746 raft_consensus.cc:979] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:58.142874 26746 raft_consensus.cc:1067] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Signalling peer 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:58.143635 26607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:37648
I20240501 08:10:58.143867 26607 raft_consensus.cc:482] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:58.143981 26607 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.146102 26607 raft_consensus.cc:504] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.147003 26607 leader_election.cc:288] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:58.147661 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:58.147701 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df9f6410bbdb4687a638bd22a5fd7c93" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:58.147900 26458 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.147969 26532 raft_consensus.cc:3032] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:10:58.148092 26532 raft_consensus.cc:729] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:58.148417 26532 consensus_queue.cc:260] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.148794 26532 raft_consensus.cc:3037] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.150524 26458 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:58.150990 26572 leader_election.cc:302] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:58.151216 26532 raft_consensus.cc:2454] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 3.
I20240501 08:10:58.151342 26776 raft_consensus.cc:2781] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:10:58.151808 26776 raft_consensus.cc:686] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:58.152149 26776 consensus_queue.cc:237] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.155064 26354 catalog_manager.cc:5484] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 2 to 3, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 3 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:58.217490 26777 raft_consensus.cc:979] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.217677 26777 raft_consensus.cc:1067] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 LEADER]: Signalling peer a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.218370 26458 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:33980
I20240501 08:10:58.218569 26458 raft_consensus.cc:482] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:58.218693 26458 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:58.220646 26458 raft_consensus.cc:504] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.221415 26458 leader_election.cc:288] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 4 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:58.221912 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:58.221944 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "85d6d06fac2f47759cff9c01989a53a7" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:58.222146 26607 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:58.222143 26532 raft_consensus.cc:3032] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:10:58.222288 26532 raft_consensus.cc:729] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:58.222575 26532 consensus_queue.cc:260] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.222972 26532 raft_consensus.cc:3037] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:10:58.224732 26746 raft_consensus.cc:979] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.224890 26746 raft_consensus.cc:1067] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Signalling peer a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.225379 26607 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 4.
I20240501 08:10:58.225524 26458 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:33980
I20240501 08:10:58.225773 26458 raft_consensus.cc:482] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:58.225829 26532 raft_consensus.cc:2454] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 4.
I20240501 08:10:58.225901 26458 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.225855 26424 leader_election.cc:302] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:58.226696 26784 raft_consensus.cc:2781] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:10:58.227169 26784 raft_consensus.cc:686] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 4 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:58.227528 26784 consensus_queue.cc:237] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.228329 26458 raft_consensus.cc:504] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.229071 26458 leader_election.cc:288] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 5 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:58.229607 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:58.229756 26532 raft_consensus.cc:3032] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Stepping down as leader of term 4
I20240501 08:10:58.229861 26532 raft_consensus.cc:729] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:58.230090 26532 consensus_queue.cc:260] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.230126 26354 catalog_manager.cc:5484] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 3 to 4, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 4 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:58.230401 26532 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.231114 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd202ed3ff104e738f2b427fb88cb9d4" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:58.231325 26607 raft_consensus.cc:3037] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.232637 26532 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 5.
I20240501 08:10:58.233023 26425 leader_election.cc:302] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a2a7d6d7ada44df89dcc51d4e655b2c, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:58.233289 26784 raft_consensus.cc:2781] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Leader election won for term 5
I20240501 08:10:58.233480 26784 raft_consensus.cc:686] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 5 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:58.233804 26784 consensus_queue.cc:237] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.233886 26607 raft_consensus.cc:2454] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 5.
I20240501 08:10:58.236258 26354 catalog_manager.cc:5484] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 4 to 5, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 5 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:58.330206 26746 raft_consensus.cc:979] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:58.330448 26746 raft_consensus.cc:1067] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Signalling peer 7aa79ac63b854bc7994896637a914f62 to start an election
I20240501 08:10:58.331229 26607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124"
dest_uuid: "7aa79ac63b854bc7994896637a914f62"
from {username='slave'} at 127.0.0.1:37648
I20240501 08:10:58.331455 26607 raft_consensus.cc:482] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:58.331578 26607 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.333590 26607 raft_consensus.cc:504] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.334206 26607 leader_election.cc:288] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 5 election: Requested vote from peers a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629), 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229)
I20240501 08:10:58.334789 26458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
I20240501 08:10:58.334812 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036f7fe4dd8c492bac5ccfaaa72c9124" candidate_uuid: "7aa79ac63b854bc7994896637a914f62" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:58.334993 26458 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.335017 26532 raft_consensus.cc:3032] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Stepping down as leader of term 4
I20240501 08:10:58.335187 26532 raft_consensus.cc:729] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:58.335489 26532 consensus_queue.cc:260] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.335839 26532 raft_consensus.cc:3037] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:10:58.337384 26458 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 5.
I20240501 08:10:58.337826 26572 leader_election.cc:302] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:58.337832 26532 raft_consensus.cc:2454] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7aa79ac63b854bc7994896637a914f62 in term 5.
I20240501 08:10:58.338114 26776 raft_consensus.cc:2781] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Leader election won for term 5
I20240501 08:10:58.338264 26776 raft_consensus.cc:686] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 5 LEADER]: Becoming Leader. State: Replica: 7aa79ac63b854bc7994896637a914f62, State: Running, Role: LEADER
I20240501 08:10:58.338501 26776 consensus_queue.cc:237] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.341053 26354 catalog_manager.cc:5484] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 reported cstate change: term changed from 4 to 5, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to 7aa79ac63b854bc7994896637a914f62 (127.25.181.131). New cstate: current_term: 5 leader_uuid: "7aa79ac63b854bc7994896637a914f62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: HEALTHY } } }
I20240501 08:10:58.483127 26777 raft_consensus.cc:979] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: : Instructing follower a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.483327 26777 raft_consensus.cc:1067] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Signalling peer a8ab803e6faa4aab834acec7360ebb21 to start an election
I20240501 08:10:58.484004 26458 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa"
dest_uuid: "a8ab803e6faa4aab834acec7360ebb21"
from {username='slave'} at 127.0.0.1:33980
I20240501 08:10:58.484244 26458 raft_consensus.cc:482] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:10:58.484354 26458 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.486341 26458 raft_consensus.cc:504] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.486968 26458 leader_election.cc:288] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 3 election: Requested vote from peers 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130:39229), 7aa79ac63b854bc7994896637a914f62 (127.25.181.131:41375)
I20240501 08:10:58.487562 26607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7aa79ac63b854bc7994896637a914f62"
I20240501 08:10:58.487571 26532 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66ee272d343b46f58f04c5962dfadffa" candidate_uuid: "a8ab803e6faa4aab834acec7360ebb21" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c"
I20240501 08:10:58.487818 26532 raft_consensus.cc:3032] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:10:58.487836 26607 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.487982 26532 raft_consensus.cc:729] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3a2a7d6d7ada44df89dcc51d4e655b2c, State: Running, Role: LEADER
I20240501 08:10:58.488282 26532 consensus_queue.cc:260] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.488715 26532 raft_consensus.cc:3037] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:10:58.490972 26607 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 3.
I20240501 08:10:58.491492 26424 leader_election.cc:302] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7aa79ac63b854bc7994896637a914f62, a8ab803e6faa4aab834acec7360ebb21; no voters:
I20240501 08:10:58.491542 26532 raft_consensus.cc:2454] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8ab803e6faa4aab834acec7360ebb21 in term 3.
I20240501 08:10:58.491854 26784 raft_consensus.cc:2781] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:10:58.492017 26784 raft_consensus.cc:686] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 3 LEADER]: Becoming Leader. State: Replica: a8ab803e6faa4aab834acec7360ebb21, State: Running, Role: LEADER
I20240501 08:10:58.492339 26784 consensus_queue.cc:237] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } }
I20240501 08:10:58.495199 26354 catalog_manager.cc:5484] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 reported cstate change: term changed from 2 to 3, leader changed from 3a2a7d6d7ada44df89dcc51d4e655b2c (127.25.181.130) to a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129). New cstate: current_term: 3 leader_uuid: "a8ab803e6faa4aab834acec7360ebb21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 } health_report { overall_health: UNKNOWN } } }
I20240501 08:10:58.532202 26532 raft_consensus.cc:1261] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:58.532829 26778 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:58.536677 26458 raft_consensus.cc:1261] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:58.537235 26778 consensus_queue.cc:1035] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:58.652673 26532 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:58.653251 26784 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:58.657500 26607 raft_consensus.cc:1261] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:10:58.657971 26784 consensus_queue.cc:1035] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:10:58.700330 26607 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:10:58.700842 26784 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:10:58.704293 26532 raft_consensus.cc:1261] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:10:58.704886 26796 consensus_queue.cc:1035] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:10:58.719107 26458 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:10:58.719689 26776 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ab803e6faa4aab834acec7360ebb21" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 33629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:10:58.723369 26532 raft_consensus.cc:1261] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Refusing update from remote peer 7aa79ac63b854bc7994896637a914f62: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:10:58.724098 26776 consensus_queue.cc:1035] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:10:58.996675 26607 raft_consensus.cc:1261] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:58.997284 26796 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7aa79ac63b854bc7994896637a914f62" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 41375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:59.001338 26532 raft_consensus.cc:1261] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Refusing update from remote peer a8ab803e6faa4aab834acec7360ebb21: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:10:59.002081 26785 consensus_queue.cc:1035] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a2a7d6d7ada44df89dcc51d4e655b2c" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:10:59.120564 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:10:59.122251 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:10:59.122455 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:00.122871 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:00.124610 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:00.124790 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:01.125254 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:01.126981 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:01.127167 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:02.127643 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:02.129298 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:02.129472 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:03.130046 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:03.132221 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:03.132445 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:04.132975 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:04.135269 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:04.135524 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:05.136080 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:05.137635 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:05.137825 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:06.138299 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:06.139973 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:06.140136 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:07.140573 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:07.142253 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:07.142421 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:08.153167 26326 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240501 08:11:08.153510 26326 tablet_server.cc:178] TabletServer@127.25.181.129:0 shutting down...
W20240501 08:11:08.163312 26572 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20240501 08:11:08.166273 26572 consensus_peers.cc:485] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 -> Peer a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629): Couldn't send request to peer a8ab803e6faa4aab834acec7360ebb21. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:08.166716 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:08.167073 26326 tablet_replica.cc:330] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.167586 26326 raft_consensus.cc:2229] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 4 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.168023 26326 raft_consensus.cc:2258] T 85d6d06fac2f47759cff9c01989a53a7 P a8ab803e6faa4aab834acec7360ebb21 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.169440 26326 tablet_replica.cc:330] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.169612 26326 raft_consensus.cc:2229] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.169754 26326 raft_consensus.cc:2258] T 036f7fe4dd8c492bac5ccfaaa72c9124 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.170194 26326 tablet_replica.cc:330] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.170347 26326 raft_consensus.cc:2229] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.170508 26326 raft_consensus.cc:2258] T 56c8a479965c49f5ade08d8628767254 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.170954 26326 tablet_replica.cc:330] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.171109 26326 raft_consensus.cc:2229] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.171248 26326 raft_consensus.cc:2258] T df9f6410bbdb4687a638bd22a5fd7c93 P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.171691 26326 tablet_replica.cc:330] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.171847 26326 raft_consensus.cc:2229] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.171999 26326 raft_consensus.cc:2258] T 818e3ab66b874857b3542484aa3c17f5 P a8ab803e6faa4aab834acec7360ebb21 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.172391 26326 tablet_replica.cc:330] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.172544 26326 raft_consensus.cc:2229] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.172678 26326 raft_consensus.cc:2258] T e6b1d8dfae61449d9fd5d0ed2f27c668 P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.173092 26326 tablet_replica.cc:330] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.173228 26326 raft_consensus.cc:2229] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 3 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.173520 26326 raft_consensus.cc:2258] T 66ee272d343b46f58f04c5962dfadffa P a8ab803e6faa4aab834acec7360ebb21 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.173923 26326 tablet_replica.cc:330] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.174075 26326 raft_consensus.cc:2229] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.174213 26326 raft_consensus.cc:2258] T 38338ee9cf0f4e7f89f568c0a0369e5b P a8ab803e6faa4aab834acec7360ebb21 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.174608 26326 tablet_replica.cc:330] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21: stopping tablet replica
I20240501 08:11:08.174741 26326 raft_consensus.cc:2229] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 5 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.174997 26326 raft_consensus.cc:2258] T cd202ed3ff104e738f2b427fb88cb9d4 P a8ab803e6faa4aab834acec7360ebb21 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.192181 26326 tablet_server.cc:194] TabletServer@127.25.181.129:0 shutdown complete.
I20240501 08:11:08.199364 26326 tablet_server.cc:178] TabletServer@127.25.181.130:0 shutting down...
I20240501 08:11:08.208609 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:08.208949 26326 tablet_replica.cc:330] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.209138 26326 raft_consensus.cc:2229] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.209358 26326 raft_consensus.cc:2258] T cd202ed3ff104e738f2b427fb88cb9d4 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.209967 26326 tablet_replica.cc:330] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.210145 26326 raft_consensus.cc:2229] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.210427 26326 raft_consensus.cc:2258] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.210922 26326 tablet_replica.cc:330] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.211068 26326 raft_consensus.cc:2229] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.211225 26326 raft_consensus.cc:2258] T 56c8a479965c49f5ade08d8628767254 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.211655 26326 tablet_replica.cc:330] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.211814 26326 raft_consensus.cc:2229] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.212232 26326 raft_consensus.cc:2258] T 38338ee9cf0f4e7f89f568c0a0369e5b P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.212698 26326 tablet_replica.cc:330] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.212854 26326 raft_consensus.cc:2229] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.213011 26326 raft_consensus.cc:2258] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.213434 26326 tablet_replica.cc:330] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.213590 26326 raft_consensus.cc:2229] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.213730 26326 raft_consensus.cc:2258] T 85d6d06fac2f47759cff9c01989a53a7 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.214148 26326 tablet_replica.cc:330] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.214283 26326 raft_consensus.cc:2229] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.214432 26326 raft_consensus.cc:2258] T 66ee272d343b46f58f04c5962dfadffa P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.214812 26326 tablet_replica.cc:330] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.214962 26326 raft_consensus.cc:2229] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.215211 26326 raft_consensus.cc:2258] T 818e3ab66b874857b3542484aa3c17f5 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.215654 26326 tablet_replica.cc:330] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c: stopping tablet replica
I20240501 08:11:08.215787 26326 raft_consensus.cc:2229] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.215935 26326 raft_consensus.cc:2258] T df9f6410bbdb4687a638bd22a5fd7c93 P 3a2a7d6d7ada44df89dcc51d4e655b2c [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.233181 26326 tablet_server.cc:194] TabletServer@127.25.181.130:0 shutdown complete.
W20240501 08:11:08.234709 26572 consensus_peers.cc:485] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 -> Peer a8ab803e6faa4aab834acec7360ebb21 (127.25.181.129:33629): Couldn't send request to peer a8ab803e6faa4aab834acec7360ebb21. Status: Network error: Client connection negotiation failed: client connection to 127.25.181.129:33629: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:08.237593 26326 tablet_server.cc:178] TabletServer@127.25.181.131:0 shutting down...
I20240501 08:11:08.247128 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:08.247416 26326 tablet_replica.cc:330] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.247603 26326 raft_consensus.cc:2229] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.247799 26326 raft_consensus.cc:2258] T 66ee272d343b46f58f04c5962dfadffa P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.248356 26326 tablet_replica.cc:330] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.248499 26326 raft_consensus.cc:2229] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.248759 26326 raft_consensus.cc:2258] T 56c8a479965c49f5ade08d8628767254 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.249214 26326 tablet_replica.cc:330] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.249323 26326 raft_consensus.cc:2229] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.249449 26326 raft_consensus.cc:2258] T 818e3ab66b874857b3542484aa3c17f5 P 7aa79ac63b854bc7994896637a914f62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.249809 26326 tablet_replica.cc:330] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.249944 26326 raft_consensus.cc:2229] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.250058 26326 raft_consensus.cc:2258] T e6b1d8dfae61449d9fd5d0ed2f27c668 P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.250424 26326 tablet_replica.cc:330] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.250532 26326 raft_consensus.cc:2229] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.250656 26326 raft_consensus.cc:2258] T 38338ee9cf0f4e7f89f568c0a0369e5b P 7aa79ac63b854bc7994896637a914f62 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.251013 26326 tablet_replica.cc:330] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.251132 26326 raft_consensus.cc:2229] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.251250 26326 raft_consensus.cc:2258] T 85d6d06fac2f47759cff9c01989a53a7 P 7aa79ac63b854bc7994896637a914f62 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.251679 26326 tablet_replica.cc:330] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.251787 26326 raft_consensus.cc:2229] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 5 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.252032 26326 raft_consensus.cc:2258] T 036f7fe4dd8c492bac5ccfaaa72c9124 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.252401 26326 tablet_replica.cc:330] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.252516 26326 raft_consensus.cc:2229] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 3 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.252728 26326 raft_consensus.cc:2258] T df9f6410bbdb4687a638bd22a5fd7c93 P 7aa79ac63b854bc7994896637a914f62 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.253114 26326 tablet_replica.cc:330] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62: stopping tablet replica
I20240501 08:11:08.253216 26326 raft_consensus.cc:2229] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:08.253341 26326 raft_consensus.cc:2258] T cd202ed3ff104e738f2b427fb88cb9d4 P 7aa79ac63b854bc7994896637a914f62 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.268791 26326 tablet_server.cc:194] TabletServer@127.25.181.131:0 shutdown complete.
I20240501 08:11:08.273538 26326 master.cc:537] Master@127.25.181.190:45383 shutting down...
I20240501 08:11:08.282883 26326 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 1 LEADER]: Raft consensus shutting down.
I20240501 08:11:08.283150 26326 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:08.283310 26326 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3025c56aaec746889336bfd8ba02081d: stopping tablet replica
I20240501 08:11:08.296798 26326 master.cc:552] Master@127.25.181.190:45383 shutdown complete.
3a2a7d6d7ada44df89dcc51d4e655b2c 4
7aa79ac63b854bc7994896637a914f62 1
a8ab803e6faa4aab834acec7360ebb21 4
3a2a7d6d7ada44df89dcc51d4e655b2c 3
7aa79ac63b854bc7994896637a914f62 3
a8ab803e6faa4aab834acec7360ebb21 3
3a2a7d6d7ada44df89dcc51d4e655b2c 8
7aa79ac63b854bc7994896637a914f62 1
a8ab803e6faa4aab834acec7360ebb21 0
3a2a7d6d7ada44df89dcc51d4e655b2c 3
7aa79ac63b854bc7994896637a914f62 3
a8ab803e6faa4aab834acec7360ebb21 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27572 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240501 08:11:08.316183 26326 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.181.190:45569
I20240501 08:11:08.316746 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:08.320318 26812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.321087 26813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.322180 26815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:08.322908 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:08.323215 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:08.323393 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:08.323474 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551068323440 us; error 0 us; skew 500 ppm
I20240501 08:11:08.323663 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:08.325071 26326 webserver.cc:460] Webserver started at http://127.25.181.190:36167/ using document root <none> and password file <none>
I20240501 08:11:08.325314 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:08.325408 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:08.325551 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:08.326275 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/master-0-root/instance:
uuid: "51b06daa8606410380eff8884b6c0749"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.328917 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 08:11:08.330670 26820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.331095 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240501 08:11:08.331230 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/master-0-root
uuid: "51b06daa8606410380eff8884b6c0749"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.331640 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:08.345784 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:08.346469 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:08.361397 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.190:45569
I20240501 08:11:08.361430 26871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.190:45569 every 8 connection(s)
I20240501 08:11:08.362807 26872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.366962 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749: Bootstrap starting.
I20240501 08:11:08.368543 26872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.370290 26872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749: No bootstrap required, opened a new log
I20240501 08:11:08.370867 26872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER }
I20240501 08:11:08.371002 26872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.371068 26872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51b06daa8606410380eff8884b6c0749, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.371246 26872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER }
I20240501 08:11:08.371423 26872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:11:08.371480 26872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:11:08.371557 26872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:08.373318 26872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER }
I20240501 08:11:08.373536 26872 leader_election.cc:302] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51b06daa8606410380eff8884b6c0749; no voters:
I20240501 08:11:08.373871 26872 leader_election.cc:288] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:11:08.374035 26875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:08.374533 26875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 1 LEADER]: Becoming Leader. State: Replica: 51b06daa8606410380eff8884b6c0749, State: Running, Role: LEADER
I20240501 08:11:08.374732 26872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:11:08.374802 26875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER }
I20240501 08:11:08.376075 26877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51b06daa8606410380eff8884b6c0749. Latest consensus state: current_term: 1 leader_uuid: "51b06daa8606410380eff8884b6c0749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER } }
I20240501 08:11:08.376020 26876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51b06daa8606410380eff8884b6c0749" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b06daa8606410380eff8884b6c0749" member_type: VOTER } }
I20240501 08:11:08.376261 26877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [sys.catalog]: This master's current role is: LEADER
I20240501 08:11:08.377157 26876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [sys.catalog]: This master's current role is: LEADER
I20240501 08:11:08.377220 26881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:11:08.379179 26881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:11:08.380954 26326 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 08:11:08.382462 26881 catalog_manager.cc:1347] Generated new cluster ID: 88ae4379558c4720941f01191193a303
I20240501 08:11:08.382551 26881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:11:08.393188 26881 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:11:08.393956 26881 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:11:08.402046 26881 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749: Generated new TSK 0
I20240501 08:11:08.402302 26881 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:11:08.413997 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:08.418102 26893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.418772 26894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.419744 26896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:08.420500 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:08.420763 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:08.420835 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:08.420886 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551068420870 us; error 0 us; skew 500 ppm
I20240501 08:11:08.421022 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:08.422396 26326 webserver.cc:460] Webserver started at http://127.25.181.129:34123/ using document root <none> and password file <none>
I20240501 08:11:08.422636 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:08.422708 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:08.422832 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:08.423518 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-0-root/instance:
uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.426056 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:08.427659 26901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.428045 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 08:11:08.428170 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.428292 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:08.451537 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:08.452206 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:08.452867 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:08.453876 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:08.453969 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.454088 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:08.454173 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.470414 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.129:34875
I20240501 08:11:08.470444 26963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.129:34875 every 8 connection(s)
I20240501 08:11:08.472200 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:08.476271 26968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.476907 26969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.477836 26971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:08.478550 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:08.479130 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:08.479226 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:08.479346 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551068479271 us; error 0 us; skew 500 ppm
I20240501 08:11:08.479524 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:08.480448 26964 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45569
I20240501 08:11:08.480587 26964 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:08.481063 26964 heartbeater.cc:511] Master 127.25.181.190:45569 requested a full tablet report, sending...
I20240501 08:11:08.481127 26326 webserver.cc:460] Webserver started at http://127.25.181.130:38167/ using document root <none> and password file <none>
I20240501 08:11:08.481379 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:08.481498 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:08.481647 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:08.482048 26837 ts_manager.cc:194] Registered new tserver with Master: 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875)
I20240501 08:11:08.482357 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-1-root/instance:
uuid: "ad223d405eb642b4bce1825c85b9d368"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.483126 26837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58858
I20240501 08:11:08.485412 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20240501 08:11:08.487046 26976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.487432 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:08.487550 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
uuid: "ad223d405eb642b4bce1825c85b9d368"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.487692 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:08.506009 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:08.506665 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:08.507268 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:08.508235 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:08.508311 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.508440 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:08.508507 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.522527 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.130:37011
I20240501 08:11:08.522547 27038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.130:37011 every 8 connection(s)
I20240501 08:11:08.524140 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 08:11:08.529367 26326 server_base.cc:1034] running on GCE node
W20240501 08:11:08.530350 27042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:08.531116 27043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:08.531558 27039 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45569
I20240501 08:11:08.531741 27039 heartbeater.cc:464] Registering TS with master...
W20240501 08:11:08.531949 27045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:08.532213 27039 heartbeater.cc:511] Master 127.25.181.190:45569 requested a full tablet report, sending...
I20240501 08:11:08.532410 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:08.532536 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:08.532608 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551068532585 us; error 0 us; skew 500 ppm
I20240501 08:11:08.532825 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:08.533337 26837 ts_manager.cc:194] Registered new tserver with Master: ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:08.534345 26837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58866
I20240501 08:11:08.534327 26326 webserver.cc:460] Webserver started at http://127.25.181.131:42517/ using document root <none> and password file <none>
I20240501 08:11:08.534662 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:08.534778 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:08.534936 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:08.535652 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-2-root/instance:
uuid: "dc38b21f6ad04ef89faab75268a00e15"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.538179 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:08.539928 27050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.540344 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:08.540452 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
uuid: "dc38b21f6ad04ef89faab75268a00e15"
format_stamp: "Formatted at 2024-05-01 08:11:08 on dist-test-slave-4f6n"
I20240501 08:11:08.540557 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714551040672050-26326-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:08.552342 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:08.552955 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:08.553529 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:08.554416 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:08.554497 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.554602 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:08.554673 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:08.571228 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.131:34859
I20240501 08:11:08.571266 27112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.131:34859 every 8 connection(s)
I20240501 08:11:08.578547 27113 heartbeater.cc:347] Connected to a master server at 127.25.181.190:45569
I20240501 08:11:08.578698 27113 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:08.579177 27113 heartbeater.cc:511] Master 127.25.181.190:45569 requested a full tablet report, sending...
I20240501 08:11:08.580072 26837 ts_manager.cc:194] Registered new tserver with Master: dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:08.580219 26326 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007923897s
I20240501 08:11:08.580852 26837 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58880
I20240501 08:11:08.581372 26326 test_util.cc:268] Using random seed: 124018141
I20240501 08:11:08.593096 26837 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58886:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 08:11:08.593956 26837 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 08:11:08.634905 27004 tablet_service.cc:1467] Processing CreateTablet for tablet 8c97597633db432985009e3078a7fb2b (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 08:11:08.635551 27004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c97597633db432985009e3078a7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.635620 26929 tablet_service.cc:1467] Processing CreateTablet for tablet 8c97597633db432985009e3078a7fb2b (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 08:11:08.636291 26929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c97597633db432985009e3078a7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.637310 27002 tablet_service.cc:1467] Processing CreateTablet for tablet fad2da8a30c94cb5bc54f57b1cd34209 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 08:11:08.637838 27002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad2da8a30c94cb5bc54f57b1cd34209. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.635895 27003 tablet_service.cc:1467] Processing CreateTablet for tablet e8c020780ad645d28ac8701444ac8cf2 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 08:11:08.638971 27077 tablet_service.cc:1467] Processing CreateTablet for tablet e8c020780ad645d28ac8701444ac8cf2 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 08:11:08.640103 26998 tablet_service.cc:1467] Processing CreateTablet for tablet 844f1fb520eb4faaa0bae6d848123554 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 08:11:08.642251 27000 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1246028a4e4bb19839bd2ce315dc6f (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 08:11:08.643033 27003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c020780ad645d28ac8701444ac8cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.643170 27077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c020780ad645d28ac8701444ac8cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.643458 27001 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9f1a0de64044988739777992f25c4d (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 08:11:08.645078 27000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1246028a4e4bb19839bd2ce315dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.645264 26997 tablet_service.cc:1467] Processing CreateTablet for tablet 391f91c293784100af2f6ae1b0933d5c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 08:11:08.646008 26995 tablet_service.cc:1467] Processing CreateTablet for tablet a4d20a01457246c2a52717ecfb70f39c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 08:11:08.646040 27075 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9f1a0de64044988739777992f25c4d (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 08:11:08.646541 27075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9f1a0de64044988739777992f25c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.648649 26998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844f1fb520eb4faaa0bae6d848123554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.650897 26999 tablet_service.cc:1467] Processing CreateTablet for tablet f19daebefbb64599853b03d6ad38d5b0 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 08:11:08.651571 27001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9f1a0de64044988739777992f25c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.651815 26997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391f91c293784100af2f6ae1b0933d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.651753 27074 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1246028a4e4bb19839bd2ce315dc6f (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 08:11:08.652210 27074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1246028a4e4bb19839bd2ce315dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.652944 27078 tablet_service.cc:1467] Processing CreateTablet for tablet 8c97597633db432985009e3078a7fb2b (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240501 08:11:08.653316 27078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c97597633db432985009e3078a7fb2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.654047 26995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4d20a01457246c2a52717ecfb70f39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.656116 26996 tablet_service.cc:1467] Processing CreateTablet for tablet a3bee4cdc09e455c8fa5a52d947f8635 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 08:11:08.658986 26999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19daebefbb64599853b03d6ad38d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.658346 27073 tablet_service.cc:1467] Processing CreateTablet for tablet f19daebefbb64599853b03d6ad38d5b0 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 08:11:08.662048 26996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bee4cdc09e455c8fa5a52d947f8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.665578 27073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19daebefbb64599853b03d6ad38d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.664073 26926 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9f1a0de64044988739777992f25c4d (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240501 08:11:08.665727 27071 tablet_service.cc:1467] Processing CreateTablet for tablet 391f91c293784100af2f6ae1b0933d5c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 08:11:08.666124 27072 tablet_service.cc:1467] Processing CreateTablet for tablet 844f1fb520eb4faaa0bae6d848123554 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 08:11:08.667261 26927 tablet_service.cc:1467] Processing CreateTablet for tablet fad2da8a30c94cb5bc54f57b1cd34209 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 08:11:08.668503 27076 tablet_service.cc:1467] Processing CreateTablet for tablet fad2da8a30c94cb5bc54f57b1cd34209 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240501 08:11:08.668869 27070 tablet_service.cc:1467] Processing CreateTablet for tablet a3bee4cdc09e455c8fa5a52d947f8635 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 08:11:08.669791 26924 tablet_service.cc:1467] Processing CreateTablet for tablet f19daebefbb64599853b03d6ad38d5b0 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240501 08:11:08.671772 27069 tablet_service.cc:1467] Processing CreateTablet for tablet a4d20a01457246c2a52717ecfb70f39c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 08:11:08.668067 26928 tablet_service.cc:1467] Processing CreateTablet for tablet e8c020780ad645d28ac8701444ac8cf2 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240501 08:11:08.677783 27071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391f91c293784100af2f6ae1b0933d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.678431 26921 tablet_service.cc:1467] Processing CreateTablet for tablet a3bee4cdc09e455c8fa5a52d947f8635 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240501 08:11:08.678598 26923 tablet_service.cc:1467] Processing CreateTablet for tablet 844f1fb520eb4faaa0bae6d848123554 (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240501 08:11:08.681247 26926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9f1a0de64044988739777992f25c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.676702 26925 tablet_service.cc:1467] Processing CreateTablet for tablet 1b1246028a4e4bb19839bd2ce315dc6f (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240501 08:11:08.681329 26922 tablet_service.cc:1467] Processing CreateTablet for tablet 391f91c293784100af2f6ae1b0933d5c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240501 08:11:08.686854 27076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad2da8a30c94cb5bc54f57b1cd34209. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.687752 26927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fad2da8a30c94cb5bc54f57b1cd34209. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.686614 26920 tablet_service.cc:1467] Processing CreateTablet for tablet a4d20a01457246c2a52717ecfb70f39c (DEFAULT_TABLE table=test-workload [id=3e596051cda84d1ea0917e89126a91b8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240501 08:11:08.688903 26928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c020780ad645d28ac8701444ac8cf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.693394 27069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4d20a01457246c2a52717ecfb70f39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.694694 26923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844f1fb520eb4faaa0bae6d848123554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.695066 26921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bee4cdc09e455c8fa5a52d947f8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.711544 26920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4d20a01457246c2a52717ecfb70f39c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.713778 27070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3bee4cdc09e455c8fa5a52d947f8635. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.720376 26922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 391f91c293784100af2f6ae1b0933d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.722772 27072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 844f1fb520eb4faaa0bae6d848123554. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.735805 26925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b1246028a4e4bb19839bd2ce315dc6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.742926 27130 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.745211 27130 tablet_bootstrap.cc:654] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.746838 26924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f19daebefbb64599853b03d6ad38d5b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:08.752797 27128 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.787981 27129 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.789902 27128 tablet_bootstrap.cc:654] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.801328 27130 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.801510 27130 ts_tablet_manager.cc:1367] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.061s user 0.014s sys 0.023s
I20240501 08:11:08.809463 27130 raft_consensus.cc:348] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.809721 27130 raft_consensus.cc:374] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.812494 27130 raft_consensus.cc:729] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.813014 27130 consensus_queue.cc:260] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.822243 27129 tablet_bootstrap.cc:654] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.824067 27039 heartbeater.cc:503] Master 127.25.181.190:45569 was elected leader, sending a full tablet report...
I20240501 08:11:08.824079 27130 ts_tablet_manager.cc:1398] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.022s user 0.003s sys 0.003s
I20240501 08:11:08.824373 27128 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.824419 27129 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.824437 27130 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.824637 27129 ts_tablet_manager.cc:1367] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.000s
I20240501 08:11:08.824678 27128 ts_tablet_manager.cc:1367] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.075s user 0.004s sys 0.012s
I20240501 08:11:08.825573 27128 raft_consensus.cc:348] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.825811 27128 raft_consensus.cc:374] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.825923 27128 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.826256 27130 tablet_bootstrap.cc:654] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.826186 27128 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.827108 26964 heartbeater.cc:503] Master 127.25.181.190:45569 was elected leader, sending a full tablet report...
I20240501 08:11:08.828300 27130 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.828429 27128 ts_tablet_manager.cc:1398] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240501 08:11:08.828505 27130 ts_tablet_manager.cc:1367] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:08.828747 27128 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.829298 27130 raft_consensus.cc:348] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.829547 27130 raft_consensus.cc:374] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.829638 27130 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.829928 27130 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.830391 27130 ts_tablet_manager.cc:1398] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:08.830685 27130 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.830901 27128 tablet_bootstrap.cc:654] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.831972 27129 raft_consensus.cc:348] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.832137 27130 tablet_bootstrap.cc:654] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.832160 27129 raft_consensus.cc:374] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.832257 27129 raft_consensus.cc:729] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.832583 27129 consensus_queue.cc:260] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.833107 27128 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.833283 27128 ts_tablet_manager.cc:1367] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240501 08:11:08.834249 27128 raft_consensus.cc:348] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.834524 27128 raft_consensus.cc:374] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.834599 27128 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.834848 27128 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.835433 27128 ts_tablet_manager.cc:1398] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:08.835718 27128 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.837414 27128 tablet_bootstrap.cc:654] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.838930 27113 heartbeater.cc:503] Master 127.25.181.190:45569 was elected leader, sending a full tablet report...
I20240501 08:11:08.839824 27129 ts_tablet_manager.cc:1398] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240501 08:11:08.840283 27129 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.842646 27129 tablet_bootstrap.cc:654] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.844399 27128 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.844558 27128 ts_tablet_manager.cc:1367] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20240501 08:11:08.845413 27128 raft_consensus.cc:348] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.845667 27128 raft_consensus.cc:374] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.845774 27128 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.846041 27128 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.846736 27128 ts_tablet_manager.cc:1398] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240501 08:11:08.847054 27128 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.847563 27130 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.847678 27130 ts_tablet_manager.cc:1367] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.016s
I20240501 08:11:08.848402 27130 raft_consensus.cc:348] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.848560 27130 raft_consensus.cc:374] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.848630 27130 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.848803 27130 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.848961 27128 tablet_bootstrap.cc:654] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.849272 27130 ts_tablet_manager.cc:1398] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:08.849556 27130 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.851076 27130 tablet_bootstrap.cc:654] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.851112 27128 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.851303 27128 ts_tablet_manager.cc:1367] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:08.852169 27128 raft_consensus.cc:348] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.852420 27128 raft_consensus.cc:374] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.852520 27128 raft_consensus.cc:729] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.852813 27128 consensus_queue.cc:260] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.853047 27130 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.853219 27130 ts_tablet_manager.cc:1367] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20240501 08:11:08.853422 27128 ts_tablet_manager.cc:1398] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:08.853710 27128 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.853796 27130 raft_consensus.cc:348] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.853956 27130 raft_consensus.cc:374] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.854009 27130 raft_consensus.cc:729] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.854243 27130 consensus_queue.cc:260] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.854676 27130 ts_tablet_manager.cc:1398] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:08.854902 27130 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.855502 27128 tablet_bootstrap.cc:654] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.856431 27130 tablet_bootstrap.cc:654] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.856889 27129 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.857064 27129 ts_tablet_manager.cc:1367] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20240501 08:11:08.858042 27129 raft_consensus.cc:348] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.858355 27129 raft_consensus.cc:374] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.858449 27129 raft_consensus.cc:729] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.858754 27129 consensus_queue.cc:260] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.859469 27129 ts_tablet_manager.cc:1398] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:08.859848 27129 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.862053 27129 tablet_bootstrap.cc:654] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.865526 27130 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.865713 27130 ts_tablet_manager.cc:1367] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s
I20240501 08:11:08.866560 27128 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.866474 27130 raft_consensus.cc:348] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.866684 27130 raft_consensus.cc:374] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.866708 27128 ts_tablet_manager.cc:1367] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.010s
I20240501 08:11:08.866812 27130 raft_consensus.cc:729] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.867111 27130 consensus_queue.cc:260] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.867357 27129 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.867486 27129 ts_tablet_manager.cc:1367] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20240501 08:11:08.867480 27128 raft_consensus.cc:348] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.867695 27128 raft_consensus.cc:374] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.867815 27128 raft_consensus.cc:729] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.867936 27130 ts_tablet_manager.cc:1398] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:08.868204 27130 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.868083 27128 consensus_queue.cc:260] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.868669 27128 ts_tablet_manager.cc:1398] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:08.868959 27128 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.869976 27130 tablet_bootstrap.cc:654] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.870407 27138 raft_consensus.cc:482] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:08.870332 27129 raft_consensus.cc:348] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.870576 27129 raft_consensus.cc:374] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.870699 27129 raft_consensus.cc:729] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.870579 27138 raft_consensus.cc:504] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.871048 27129 consensus_queue.cc:260] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.871716 27138 leader_election.cc:288] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:08.874078 27135 raft_consensus.cc:482] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:08.874234 27135 raft_consensus.cc:504] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.875322 27135 leader_election.cc:288] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:08.883445 27128 tablet_bootstrap.cc:654] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.886415 27130 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.886626 27130 ts_tablet_manager.cc:1367] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.006s
I20240501 08:11:08.886732 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:08.887012 26939 raft_consensus.cc:2454] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 0.
I20240501 08:11:08.887544 27053 leader_election.cc:302] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:08.887545 27130 raft_consensus.cc:348] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.887807 27130 raft_consensus.cc:374] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.887848 27138 raft_consensus.cc:2781] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:08.887995 27138 raft_consensus.cc:482] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:08.887961 27130 raft_consensus.cc:729] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.888113 27138 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:08.888402 27130 consensus_queue.cc:260] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.891388 27138 raft_consensus.cc:504] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.892452 27130 ts_tablet_manager.cc:1398] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:08.892571 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:08.892791 26939 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:08.895735 27130 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.896395 26939 raft_consensus.cc:2454] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 1.
I20240501 08:11:08.896829 27053 leader_election.cc:302] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:08.897327 27138 leader_election.cc:288] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:08.897534 27138 raft_consensus.cc:2781] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:08.897650 27138 raft_consensus.cc:686] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:08.897958 27138 consensus_queue.cc:237] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.898319 27130 tablet_bootstrap.cc:654] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.916410 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:08.916512 27013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
W20240501 08:11:08.917449 27052 leader_election.cc:341] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:08.921525 27129 ts_tablet_manager.cc:1398] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.054s user 0.019s sys 0.027s
I20240501 08:11:08.923097 27129 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.925801 27129 tablet_bootstrap.cc:654] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.928174 26837 catalog_manager.cc:5484] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:08.930110 27128 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.931020 27128 ts_tablet_manager.cc:1367] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.061s user 0.013s sys 0.000s
I20240501 08:11:08.933207 27128 raft_consensus.cc:348] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.933837 27128 raft_consensus.cc:374] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.934625 27128 raft_consensus.cc:729] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.936570 27128 consensus_queue.cc:260] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.937407 27128 ts_tablet_manager.cc:1398] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:08.938546 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:08.939430 27128 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
W20240501 08:11:08.940585 26903 leader_election.cc:341] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:08.943774 27128 tablet_bootstrap.cc:654] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.945415 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:08.945698 27130 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.945744 27129 tablet_bootstrap.cc:492] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.945869 27130 ts_tablet_manager.cc:1367] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.050s user 0.017s sys 0.021s
I20240501 08:11:08.945948 27129 ts_tablet_manager.cc:1367] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.008s
I20240501 08:11:08.946250 26902 leader_election.cc:302] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca; no voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:08.946617 27135 raft_consensus.cc:2726] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:08.946839 27130 raft_consensus.cc:348] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.947055 27130 raft_consensus.cc:374] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.947170 27130 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.946995 27129 raft_consensus.cc:348] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.947348 27129 raft_consensus.cc:374] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.947468 27129 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.947440 27130 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.947814 27129 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.948026 27130 ts_tablet_manager.cc:1398] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:08.948678 27130 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.948925 27129 ts_tablet_manager.cc:1398] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20240501 08:11:08.949211 27129 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.950484 27130 tablet_bootstrap.cc:654] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.950951 27129 tablet_bootstrap.cc:654] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.957479 27128 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.957710 27128 ts_tablet_manager.cc:1367] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.006s
I20240501 08:11:08.958856 27128 raft_consensus.cc:348] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.959131 27128 raft_consensus.cc:374] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.959237 27128 raft_consensus.cc:729] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.959496 27128 consensus_queue.cc:260] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.959791 27130 tablet_bootstrap.cc:492] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.959944 27130 ts_tablet_manager.cc:1367] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20240501 08:11:08.960111 27128 ts_tablet_manager.cc:1398] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:08.960422 27128 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.960719 27130 raft_consensus.cc:348] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.960939 27130 raft_consensus.cc:374] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.961014 27130 raft_consensus.cc:729] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.961324 27130 consensus_queue.cc:260] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.962250 27128 tablet_bootstrap.cc:654] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.964640 27128 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.964821 27128 ts_tablet_manager.cc:1367] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240501 08:11:08.965078 27130 ts_tablet_manager.cc:1398] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:08.965386 27130 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.965621 27128 raft_consensus.cc:348] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.965844 27128 raft_consensus.cc:374] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.965934 27128 raft_consensus.cc:729] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.966231 27128 consensus_queue.cc:260] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.967129 27130 tablet_bootstrap.cc:654] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.967510 27128 ts_tablet_manager.cc:1398] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:08.967823 27128 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.969323 27129 tablet_bootstrap.cc:492] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.969475 27129 ts_tablet_manager.cc:1367] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.015s
I20240501 08:11:08.969602 27128 tablet_bootstrap.cc:654] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.970395 27129 raft_consensus.cc:348] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.970646 27129 raft_consensus.cc:374] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.970788 27129 raft_consensus.cc:729] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.971038 27129 consensus_queue.cc:260] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.971566 27129 ts_tablet_manager.cc:1398] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:08.971787 27128 tablet_bootstrap.cc:492] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.971930 27128 ts_tablet_manager.cc:1367] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:08.972455 27129 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.972659 27128 raft_consensus.cc:348] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.972856 27128 raft_consensus.cc:374] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.972966 27128 raft_consensus.cc:729] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.973219 27128 consensus_queue.cc:260] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.973954 27128 ts_tablet_manager.cc:1398] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:08.974284 27128 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: Bootstrap starting.
I20240501 08:11:08.976161 27129 tablet_bootstrap.cc:654] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.976447 27128 tablet_bootstrap.cc:654] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.978567 27128 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: No bootstrap required, opened a new log
I20240501 08:11:08.978737 27128 ts_tablet_manager.cc:1367] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 08:11:08.978948 27129 tablet_bootstrap.cc:492] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.979019 27130 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.979178 27130 ts_tablet_manager.cc:1367] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20240501 08:11:08.979182 27129 ts_tablet_manager.cc:1367] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s
I20240501 08:11:08.979686 27128 raft_consensus.cc:348] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.979966 27128 raft_consensus.cc:374] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.979934 27129 raft_consensus.cc:348] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.980070 27128 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.979995 27130 raft_consensus.cc:348] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.980180 27129 raft_consensus.cc:374] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.980185 27130 raft_consensus.cc:374] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.980304 27129 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.980357 27130 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.980420 27128 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.980598 27129 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.980618 27130 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.981089 27129 ts_tablet_manager.cc:1398] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:08.981112 27128 ts_tablet_manager.cc:1398] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:08.981882 27129 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.983614 27130 ts_tablet_manager.cc:1398] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:08.983767 27129 tablet_bootstrap.cc:654] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.983947 27130 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: Bootstrap starting.
I20240501 08:11:08.986553 27130 tablet_bootstrap.cc:654] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.988451 27129 tablet_bootstrap.cc:492] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.988569 27129 ts_tablet_manager.cc:1367] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20240501 08:11:08.988624 27130 tablet_bootstrap.cc:492] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: No bootstrap required, opened a new log
I20240501 08:11:08.988791 27130 ts_tablet_manager.cc:1367] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 08:11:08.989244 27129 raft_consensus.cc:348] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.989406 27129 raft_consensus.cc:374] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.989391 27130 raft_consensus.cc:348] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.989539 27129 raft_consensus.cc:729] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.989648 27130 raft_consensus.cc:374] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.989742 27130 raft_consensus.cc:729] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.989786 27129 consensus_queue.cc:260] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.989993 27130 consensus_queue.cc:260] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.990258 27129 ts_tablet_manager.cc:1398] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:08.990489 27130 ts_tablet_manager.cc:1398] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:08.990569 27129 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.992300 27129 tablet_bootstrap.cc:654] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.994421 27129 tablet_bootstrap.cc:492] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.994593 27129 ts_tablet_manager.cc:1367] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:08.995350 27129 raft_consensus.cc:348] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.995527 27129 raft_consensus.cc:374] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:08.995579 27129 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:08.995743 27129 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:08.996136 27129 ts_tablet_manager.cc:1398] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 08:11:08.996426 27129 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:08.997982 27129 tablet_bootstrap.cc:654] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:08.999763 27129 tablet_bootstrap.cc:492] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:08.999893 27129 ts_tablet_manager.cc:1367] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:09.000424 27129 raft_consensus.cc:348] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.000578 27129 raft_consensus.cc:374] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:09.000675 27129 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:09.000871 27129 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.001317 27129 ts_tablet_manager.cc:1398] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:09.001564 27129 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: Bootstrap starting.
I20240501 08:11:09.003124 27129 tablet_bootstrap.cc:654] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:09.004887 27129 tablet_bootstrap.cc:492] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: No bootstrap required, opened a new log
I20240501 08:11:09.005031 27129 ts_tablet_manager.cc:1367] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240501 08:11:09.005575 27129 raft_consensus.cc:348] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.005760 27129 raft_consensus.cc:374] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:09.005833 27129 raft_consensus.cc:729] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Initialized, Role: FOLLOWER
I20240501 08:11:09.006037 27129 consensus_queue.cc:260] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.006368 27135 raft_consensus.cc:482] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.006541 27129 ts_tablet_manager.cc:1398] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:09.006511 27135 raft_consensus.cc:504] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.007118 27135 leader_election.cc:288] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.007514 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.007572 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.007793 27014 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.007802 27088 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.008144 26902 leader_election.cc:302] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.008472 27135 raft_consensus.cc:2781] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.008579 27135 raft_consensus.cc:482] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.008678 27135 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.010797 27135 raft_consensus.cc:504] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.011328 27135 leader_election.cc:288] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.011703 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.011710 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.011890 27014 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.011888 27088 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.013936 27088 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.013957 27014 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.014305 26902 leader_election.cc:302] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.014576 27135 raft_consensus.cc:2781] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.015004 27135 raft_consensus.cc:686] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.015336 27135 consensus_queue.cc:237] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.017732 26835 catalog_manager.cc:5484] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 1 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.019984 27135 raft_consensus.cc:482] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.020195 27135 raft_consensus.cc:504] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.020303 27169 raft_consensus.cc:482] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.020439 27169 raft_consensus.cc:504] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.020812 27135 leader_election.cc:288] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.021111 27169 leader_election.cc:288] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.021250 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.021476 27088 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.021706 27013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad2da8a30c94cb5bc54f57b1cd34209" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.021616 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad2da8a30c94cb5bc54f57b1cd34209" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.021823 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.021930 27013 raft_consensus.cc:2454] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.021935 27087 raft_consensus.cc:2454] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.022015 27014 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.022293 26903 leader_election.cc:302] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.022392 26902 leader_election.cc:302] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.022542 27135 raft_consensus.cc:2781] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.022616 27169 raft_consensus.cc:2781] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.022636 27135 raft_consensus.cc:482] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.022749 27169 raft_consensus.cc:482] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.022818 27135 raft_consensus.cc:3037] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.022866 27169 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.024955 27135 raft_consensus.cc:504] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.025120 27169 raft_consensus.cc:504] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.025596 27169 leader_election.cc:288] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.025803 27135 leader_election.cc:288] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.025907 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad2da8a30c94cb5bc54f57b1cd34209" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.026130 27014 raft_consensus.cc:3037] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.026196 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fad2da8a30c94cb5bc54f57b1cd34209" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.026172 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.026391 27087 raft_consensus.cc:3037] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.026394 27088 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.027456 27013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.027710 27013 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.029453 27014 raft_consensus.cc:2454] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.029716 27087 raft_consensus.cc:2454] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.029788 27088 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.029888 27138 raft_consensus.cc:482] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.030046 27138 raft_consensus.cc:504] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.030125 26902 leader_election.cc:302] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.030483 26902 leader_election.cc:302] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.030750 27135 raft_consensus.cc:2781] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.030666 27138 leader_election.cc:288] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:09.030666 27013 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.031594 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.031708 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:09.031299 27169 raft_consensus.cc:2781] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.031862 27012 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 0.
I20240501 08:11:09.031886 26939 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 0.
I20240501 08:11:09.032285 27053 leader_election.cc:302] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.032598 27138 raft_consensus.cc:2781] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.032693 27135 raft_consensus.cc:686] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.032721 27138 raft_consensus.cc:482] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.032871 27138 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.035578 27135 consensus_queue.cc:237] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.036748 27138 raft_consensus.cc:504] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.037626 27138 leader_election.cc:288] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:09.037964 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.038144 26939 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.039534 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.039731 27012 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.040508 26939 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 1.
I20240501 08:11:09.040998 27053 leader_election.cc:302] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.041371 27138 raft_consensus.cc:2781] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.041533 27138 raft_consensus.cc:686] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.041819 27138 consensus_queue.cc:237] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.042480 27012 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 1.
I20240501 08:11:09.043367 27169 raft_consensus.cc:686] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.043676 27169 consensus_queue.cc:237] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.045492 26835 catalog_manager.cc:5484] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:09.046914 26834 catalog_manager.cc:5484] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 1 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.047566 26834 catalog_manager.cc:5484] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 1 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.064339 27133 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.064543 27133 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.065507 27133 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.069475 27169 raft_consensus.cc:482] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.069712 27169 raft_consensus.cc:504] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.070652 27169 leader_election.cc:288] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.070914 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c020780ad645d28ac8701444ac8cf2" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.070919 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c020780ad645d28ac8701444ac8cf2" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.071149 27012 raft_consensus.cc:2454] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.071241 27088 raft_consensus.cc:2454] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.071746 26902 leader_election.cc:302] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.072319 27169 raft_consensus.cc:2781] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.072438 27169 raft_consensus.cc:482] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.072548 27169 raft_consensus.cc:3037] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.074759 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:09.074872 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.074975 26939 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 0.
I20240501 08:11:09.075083 27088 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 0.
I20240501 08:11:09.075394 26979 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.075582 27169 raft_consensus.cc:504] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.075708 27133 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.075850 27133 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.075942 27133 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.076309 27169 leader_election.cc:288] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.076638 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c020780ad645d28ac8701444ac8cf2" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.076763 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c020780ad645d28ac8701444ac8cf2" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.076874 27012 raft_consensus.cc:3037] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.076956 27088 raft_consensus.cc:3037] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.078490 27133 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.079589 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.079589 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.079844 27087 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.080065 27012 raft_consensus.cc:2454] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.080065 27088 raft_consensus.cc:2454] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.080523 26902 leader_election.cc:302] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.080895 27169 raft_consensus.cc:2781] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.081049 27169 raft_consensus.cc:686] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.081343 27169 consensus_queue.cc:237] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.082454 27087 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 1.
I20240501 08:11:09.079824 26939 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.083031 26977 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.084429 26834 catalog_manager.cc:5484] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 1 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.085721 26939 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 1.
I20240501 08:11:09.086091 27133 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.086369 27179 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.086517 27179 raft_consensus.cc:686] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.086844 27179 consensus_queue.cc:237] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.090358 26834 catalog_manager.cc:5484] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 1 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.104452 27138 raft_consensus.cc:482] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.104692 27138 raft_consensus.cc:504] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.105373 27138 leader_election.cc:288] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:09.105990 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:09.105999 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.106285 26939 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 0.
I20240501 08:11:09.106328 27012 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 0.
I20240501 08:11:09.106690 27053 leader_election.cc:302] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.106956 27138 raft_consensus.cc:2781] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.107074 27138 raft_consensus.cc:482] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.107158 27138 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.109079 27138 raft_consensus.cc:504] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.109653 27138 leader_election.cc:288] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:09.110154 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.110160 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.110343 27012 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.110361 26939 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.111178 27169 raft_consensus.cc:482] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.111375 27169 raft_consensus.cc:504] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.112301 27169 leader_election.cc:288] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.112627 27013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368" is_pre_election: true
I20240501 08:11:09.112850 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.112856 27013 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.113021 27087 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 0.
I20240501 08:11:09.113379 27012 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 1.
I20240501 08:11:09.113431 26902 leader_election.cc:302] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.113749 27052 leader_election.cc:302] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.113766 27169 raft_consensus.cc:2781] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.113940 27169 raft_consensus.cc:482] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.114006 26939 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 1.
I20240501 08:11:09.114081 27169 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.114053 27138 raft_consensus.cc:2781] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.114261 27138 raft_consensus.cc:686] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.114609 27138 consensus_queue.cc:237] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.116711 27169 raft_consensus.cc:504] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.117367 27169 leader_election.cc:288] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.117866 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.117797 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.118099 27087 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.118101 27012 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.117832 26834 catalog_manager.cc:5484] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:09.121455 27012 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.121474 27087 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 1.
I20240501 08:11:09.121978 26902 leader_election.cc:302] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.122293 27169 raft_consensus.cc:2781] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.122444 27169 raft_consensus.cc:686] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.122720 27169 consensus_queue.cc:237] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.125312 26834 catalog_manager.cc:5484] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 1 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.157513 27179 raft_consensus.cc:482] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.157745 27179 raft_consensus.cc:504] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.158360 27179 leader_election.cc:288] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.158943 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.158962 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:09.159204 27087 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 0.
I20240501 08:11:09.159229 26939 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 0.
I20240501 08:11:09.159631 26979 leader_election.cc:302] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.159926 27179 raft_consensus.cc:2781] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:09.160027 27179 raft_consensus.cc:482] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:09.160151 27179 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.162050 27179 raft_consensus.cc:504] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.162689 27179 leader_election.cc:288] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.163164 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.163163 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.163437 26939 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.163453 27087 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.166397 27087 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 1.
I20240501 08:11:09.166402 26939 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 1.
I20240501 08:11:09.166886 26977 leader_election.cc:302] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.167168 27179 raft_consensus.cc:2781] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:09.167347 27179 raft_consensus.cc:686] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.167627 27179 consensus_queue.cc:237] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.170397 26834 catalog_manager.cc:5484] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 1 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.222175 27012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:48588
I20240501 08:11:09.222416 27012 raft_consensus.cc:595] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:09.231478 27087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:41230
I20240501 08:11:09.231688 27087 raft_consensus.cc:595] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:09.234989 27087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:41230
I20240501 08:11:09.235168 27087 raft_consensus.cc:595] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:09.241521 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:50908
I20240501 08:11:09.241735 26939 raft_consensus.cc:595] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:09.243759 27087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:41230
I20240501 08:11:09.243916 27087 raft_consensus.cc:595] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:09.245750 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:50908
I20240501 08:11:09.245915 26939 raft_consensus.cc:595] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:09.247781 27012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:48588
I20240501 08:11:09.247956 27012 raft_consensus.cc:595] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Received request to transfer leadership to TS dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:09.325860 27179 raft_consensus.cc:482] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:09.326093 27179 raft_consensus.cc:504] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.326797 27179 leader_election.cc:288] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.327359 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" is_pre_election: true
I20240501 08:11:09.327369 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc38b21f6ad04ef89faab75268a00e15" is_pre_election: true
I20240501 08:11:09.327665 26939 raft_consensus.cc:2379] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ad223d405eb642b4bce1825c85b9d368 in current term 1: Already voted for candidate dc38b21f6ad04ef89faab75268a00e15 in this term.
I20240501 08:11:09.328125 26979 leader_election.cc:302] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368; no voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:09.328419 27179 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:09.330389 27179 raft_consensus.cc:2726] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:09.341481 27138 consensus_queue.cc:1035] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.344084 27148 raft_consensus.cc:979] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:09.344360 27148 raft_consensus.cc:1067] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:09.345264 26938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50902
I20240501 08:11:09.346231 26938 raft_consensus.cc:482] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.346383 26938 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.346843 27138 consensus_queue.cc:1035] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.349911 26938 raft_consensus.cc:504] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.351183 26938 leader_election.cc:288] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 2 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.351254 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.351517 27087 raft_consensus.cc:3032] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.351619 27087 raft_consensus.cc:729] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.351886 27087 consensus_queue.cc:260] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.351982 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9f1a0de64044988739777992f25c4d" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.352209 27012 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.352268 27087 raft_consensus.cc:3037] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.354564 27087 raft_consensus.cc:2454] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 2.
I20240501 08:11:09.355022 26902 leader_election.cc:302] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.354622 27012 raft_consensus.cc:2454] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 2.
I20240501 08:11:09.355353 27169 raft_consensus.cc:2781] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.355543 27169 raft_consensus.cc:686] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.355801 27169 consensus_queue.cc:237] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.358055 26835 catalog_manager.cc:5484] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 1 to 2, leader changed from dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 2 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.450213 27169 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.452891 27172 raft_consensus.cc:979] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.453111 27172 raft_consensus.cc:1067] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.453886 27013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48586
I20240501 08:11:09.454111 27013 raft_consensus.cc:482] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.454268 27013 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.455142 27169 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.455857 27138 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.457317 27013 raft_consensus.cc:504] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.458868 26938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.459120 26938 raft_consensus.cc:3032] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.459218 26938 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.459507 26938 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.459756 26938 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
W20240501 08:11:09.459825 27169 consensus_queue.cc:1159] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "dc38b21f6ad04ef89faab75268a00e15" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20240501 08:11:09.460757 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.460950 27088 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.461405 27148 raft_consensus.cc:979] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.461555 27148 raft_consensus.cc:1067] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.462841 26938 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.462960 27014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48580
I20240501 08:11:09.463138 27014 raft_consensus.cc:482] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.463177 27013 leader_election.cc:288] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.463204 27138 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.463441 27014 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.463526 26979 leader_election.cc:302] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.464352 27179 raft_consensus.cc:2781] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.464507 27179 raft_consensus.cc:686] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.464830 27088 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.464807 27179 consensus_queue.cc:237] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.465682 27012 raft_consensus.cc:1226] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Rejecting Update request from peer 0a12aeacabdd426db6b4d523fe92e1ca for earlier term 1. Current term is 2. Ops: []
I20240501 08:11:09.466722 27014 raft_consensus.cc:504] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.469276 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.469621 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.469831 27088 raft_consensus.cc:3032] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.469938 27088 raft_consensus.cc:729] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.470199 27088 consensus_queue.cc:260] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.470563 27088 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.470672 26837 catalog_manager.cc:5484] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 1 to 2, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 2 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.470988 27169 consensus_queue.cc:1035] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.469626 26939 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.475175 26939 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.475476 27014 leader_election.cc:288] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.475936 26979 leader_election.cc:302] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.476217 27179 raft_consensus.cc:2781] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.476373 27179 raft_consensus.cc:686] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.476522 27088 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.476672 27179 consensus_queue.cc:237] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.479593 27135 consensus_queue.cc:1035] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.480808 26834 catalog_manager.cc:5484] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 1 to 2, leader changed from dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 2 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.513029 27138 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.515090 27169 consensus_queue.cc:1035] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.518666 27138 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.520540 27135 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.526366 27148 raft_consensus.cc:979] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.526611 27148 raft_consensus.cc:1067] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.527537 27014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48580
I20240501 08:11:09.527760 27014 raft_consensus.cc:482] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.527868 27014 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.530836 27014 raft_consensus.cc:504] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.530906 27171 consensus_queue.cc:1035] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.532760 27014 leader_election.cc:288] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.533506 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.533705 26939 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.535387 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.535634 27088 raft_consensus.cc:3032] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.535734 27088 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.536031 27088 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.536435 27088 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.536865 26939 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.537396 26979 leader_election.cc:302] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:09.537693 27179 raft_consensus.cc:2781] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.537878 27179 raft_consensus.cc:686] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.538185 27179 consensus_queue.cc:237] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.540599 26837 catalog_manager.cc:5484] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 1 to 2, leader changed from dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 2 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.540841 27171 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.542095 27088 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.543985 27135 raft_consensus.cc:979] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.544138 27135 raft_consensus.cc:1067] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:09.544736 27014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48586
I20240501 08:11:09.544914 27014 raft_consensus.cc:482] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.545048 27014 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.546962 27179 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.547457 27014 raft_consensus.cc:504] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.548010 27014 leader_election.cc:288] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.548454 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.548653 27088 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.550782 27088 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.551169 26977 leader_election.cc:302] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.551237 27135 consensus_queue.cc:1035] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.551543 27179 raft_consensus.cc:2781] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.551779 27179 raft_consensus.cc:686] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.551878 26938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.552071 26938 raft_consensus.cc:3032] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.552170 26938 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.552505 26938 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.552971 26938 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.552168 27179 consensus_queue.cc:237] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.557247 26938 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 2.
I20240501 08:11:09.561431 26835 catalog_manager.cc:5484] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 1 to 2, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 2 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.561990 27135 consensus_queue.cc:1035] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.563879 27179 raft_consensus.cc:979] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:09.564025 27179 raft_consensus.cc:1067] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:09.564787 26939 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50904
I20240501 08:11:09.565091 26939 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.565256 26939 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.566007 27204 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.568282 26939 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.569077 26938 raft_consensus.cc:1226] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Rejecting Update request from peer ad223d405eb642b4bce1825c85b9d368 for earlier term 1. Current term is 2. Ops: []
I20240501 08:11:09.569240 26939 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 2 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:09.569439 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:09.569407 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.569665 27014 raft_consensus.cc:3032] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.569761 27014 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.570029 27014 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.570290 27014 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
W20240501 08:11:09.570292 27204 consensus_queue.cc:1159] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ad223d405eb642b4bce1825c85b9d368 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20240501 08:11:09.573618 27014 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 2.
I20240501 08:11:09.574014 26903 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters: dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:09.574330 27135 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.574488 27135 raft_consensus.cc:686] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:09.574805 27135 consensus_queue.cc:237] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.577082 26837 catalog_manager.cc:5484] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 1 to 2, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 2 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:09.617570 27204 consensus_queue.cc:1035] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.620612 27133 raft_consensus.cc:979] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: : Instructing follower dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:09.620780 27133 raft_consensus.cc:1067] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Signalling peer dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:09.621414 27088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:41220
I20240501 08:11:09.621829 27088 raft_consensus.cc:482] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:09.622316 27088 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.622746 27133 consensus_queue.cc:1035] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:09.626560 27088 raft_consensus.cc:504] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.627236 27088 leader_election.cc:288] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:09.627612 26938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:09.627810 26938 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.627887 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4d20a01457246c2a52717ecfb70f39c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:09.628123 27014 raft_consensus.cc:3032] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:09.628247 27014 raft_consensus.cc:729] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:09.628583 27014 consensus_queue.cc:260] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.628957 27014 raft_consensus.cc:3037] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:09.630604 26938 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 2.
I20240501 08:11:09.630960 27053 leader_election.cc:302] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:09.631229 27148 raft_consensus.cc:2781] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:09.631395 27148 raft_consensus.cc:686] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 2 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:09.631692 27148 consensus_queue.cc:237] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:09.632815 27014 raft_consensus.cc:2454] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 2.
I20240501 08:11:09.634071 26837 catalog_manager.cc:5484] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 1 to 2, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 2 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:09.781224 27014 raft_consensus.cc:1261] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.781797 27169 consensus_queue.cc:1035] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.785426 27088 raft_consensus.cc:1261] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.785955 27135 consensus_queue.cc:1035] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.866289 26938 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.866916 27133 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.870029 27088 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.870606 27133 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.925379 26938 raft_consensus.cc:1261] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.925953 27133 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.928900 27088 raft_consensus.cc:1261] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.929492 27133 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.969801 27088 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.970386 27133 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.973536 26938 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.974294 27204 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.983204 26938 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.983727 27204 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:09.986613 27088 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:09.987208 27179 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:10.049383 27014 raft_consensus.cc:1261] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:10.049968 27148 consensus_queue.cc:1035] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:10.053124 26938 raft_consensus.cc:1261] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:10.053825 27148 consensus_queue.cc:1035] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:10.085898 27014 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:10.086570 27135 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:10.090324 27088 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:10.092991 27088 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:10.093561 27169 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:12.259972 26326 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240501 08:11:12.260224 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:12.267707 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:40816
I20240501 08:11:12.267920 26939 raft_consensus.cc:595] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Received request to transfer leadership to TS dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:12.273823 27014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:47046
I20240501 08:11:12.274029 27014 raft_consensus.cc:595] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Received request to transfer leadership to TS dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:12.274529 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240501 08:11:12.274781 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:12.488629 27179 raft_consensus.cc:979] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: : Instructing follower dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:12.488847 27179 raft_consensus.cc:1067] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Signalling peer dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:12.489464 27088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:41220
I20240501 08:11:12.489663 27088 raft_consensus.cc:482] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:12.489770 27088 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.491781 27088 raft_consensus.cc:504] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.492341 27088 leader_election.cc:288] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 3 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:12.492827 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:12.492856 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:12.493006 26939 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.493041 27014 raft_consensus.cc:3032] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:11:12.493163 27014 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:12.493412 27014 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.493736 27014 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.495138 26939 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 3.
I20240501 08:11:12.495584 27053 leader_election.cc:302] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:12.495725 27014 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 3.
I20240501 08:11:12.495883 27210 raft_consensus.cc:2781] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:11:12.496323 27210 raft_consensus.cc:686] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:12.496634 27210 consensus_queue.cc:237] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.499178 26835 catalog_manager.cc:5484] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 2 to 3, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 3 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:12.736497 27211 raft_consensus.cc:979] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:12.736680 27211 raft_consensus.cc:1067] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Signalling peer dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:12.737383 27088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:41216
I20240501 08:11:12.737572 27088 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:12.737673 27088 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.739624 27088 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.740199 27088 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 3 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:12.740738 26938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:12.740687 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:12.740933 26938 raft_consensus.cc:3032] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:11:12.740938 27014 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.741073 26938 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:12.741371 26938 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.741770 26938 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:12.744073 27014 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 3.
I20240501 08:11:12.744521 27052 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:12.744570 26938 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 3.
I20240501 08:11:12.744853 27210 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:11:12.745069 27210 raft_consensus.cc:686] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:12.745296 27210 consensus_queue.cc:237] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:12.747735 26835 catalog_manager.cc:5484] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 2 to 3, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 3 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:13.047866 26938 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:13.048527 27210 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:13.052973 27014 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:13.053815 27210 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:13.125253 26938 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:13.125870 27210 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:13.130635 27014 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:13.131254 27210 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:13.275274 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:13.277416 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:13.277626 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:14.278088 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:14.279994 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:14.280193 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:15.280570 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:15.282423 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:15.282625 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:16.283005 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:16.284703 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:16.284912 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:17.285295 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:17.286990 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:17.287199 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:18.294935 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:18.297012 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:18.297165 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:19.297751 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:19.299582 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:19.299796 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:20.300285 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:20.303467 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:20.303730 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:21.304087 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:21.305742 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:21.305907 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:22.316943 26326 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240501 08:11:22.318774 27087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:41230
I20240501 08:11:22.318993 27087 raft_consensus.cc:595] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:22.324465 27014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:48588
I20240501 08:11:22.324688 27014 raft_consensus.cc:595] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:22.326653 27014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:48588
I20240501 08:11:22.326841 27014 raft_consensus.cc:595] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:22.328615 27014 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
mode: GRACEFUL
new_leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:48588
I20240501 08:11:22.328797 27014 raft_consensus.cc:595] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Received request to transfer leadership to TS 0a12aeacabdd426db6b4d523fe92e1ca
I20240501 08:11:22.330504 27087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:41230
I20240501 08:11:22.330684 27087 raft_consensus.cc:595] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:22.429504 27232 raft_consensus.cc:979] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.429675 27232 raft_consensus.cc:1067] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.430271 26939 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50904
I20240501 08:11:22.430483 26939 raft_consensus.cc:482] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:22.430593 26939 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.432685 26939 raft_consensus.cc:504] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.433342 26939 leader_election.cc:288] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:22.433832 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:22.433835 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:22.434110 27014 raft_consensus.cc:3032] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:11:22.434118 27087 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.434208 27014 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:22.434509 27014 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.434825 27014 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.436280 27087 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.436679 26902 leader_election.cc:302] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:22.436908 27014 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.436975 27233 raft_consensus.cc:2781] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:11:22.437420 27233 raft_consensus.cc:686] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:22.437721 27233 consensus_queue.cc:237] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.440554 26835 catalog_manager.cc:5484] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 2 to 3, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 3 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:22.527741 27235 raft_consensus.cc:979] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.527938 27235 raft_consensus.cc:1067] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.528676 26939 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50904
I20240501 08:11:22.528884 26939 raft_consensus.cc:482] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:22.528981 26939 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.530880 26939 raft_consensus.cc:504] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.531512 26939 leader_election.cc:288] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:22.531924 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:22.532020 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f19daebefbb64599853b03d6ad38d5b0" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:22.532178 27014 raft_consensus.cc:3032] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:11:22.532239 27087 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.532274 27014 raft_consensus.cc:729] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:22.532549 27014 consensus_queue.cc:260] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.532850 27014 raft_consensus.cc:3037] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.534924 27087 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.535272 27014 raft_consensus.cc:2454] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.535319 26902 leader_election.cc:302] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:22.535593 27233 raft_consensus.cc:2781] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:11:22.535778 27233 raft_consensus.cc:686] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:22.536026 27233 consensus_queue.cc:237] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.538481 26835 catalog_manager.cc:5484] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 2 to 3, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 3 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:22.626744 27232 raft_consensus.cc:979] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.626941 27232 raft_consensus.cc:1067] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.627606 26939 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50904
I20240501 08:11:22.627800 26939 raft_consensus.cc:482] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:22.627887 26939 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.629874 26939 raft_consensus.cc:504] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.630467 26939 leader_election.cc:288] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:22.630913 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:22.630921 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:22.631173 27087 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.631220 27014 raft_consensus.cc:3032] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Stepping down as leader of term 2
I20240501 08:11:22.631322 27014 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:22.631628 27014 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.632025 27014 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Advancing to term 3
I20240501 08:11:22.634235 27087 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.634709 26902 leader_election.cc:302] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:22.634833 27014 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 3.
I20240501 08:11:22.635076 27233 raft_consensus.cc:2781] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Leader election won for term 3
I20240501 08:11:22.635268 27233 raft_consensus.cc:686] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:22.635625 27233 consensus_queue.cc:237] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.638290 26835 catalog_manager.cc:5484] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 2 to 3, leader changed from ad223d405eb642b4bce1825c85b9d368 (127.25.181.130) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 3 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:22.702877 27216 raft_consensus.cc:979] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: : Instructing follower 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.703043 27216 raft_consensus.cc:1067] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Signalling peer 0a12aeacabdd426db6b4d523fe92e1ca to start an election
I20240501 08:11:22.703689 26939 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
from {username='slave'} at 127.0.0.1:50902
I20240501 08:11:22.703878 26939 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:22.703976 26939 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.705904 26939 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.706461 26939 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 4 election: Requested vote from peers ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:22.706910 27014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:22.706998 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:22.707127 27014 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.707214 27087 raft_consensus.cc:3032] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:11:22.707346 27087 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:22.707640 27087 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.707966 27087 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.709496 27014 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 4.
I20240501 08:11:22.709910 26903 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:22.709977 27087 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a12aeacabdd426db6b4d523fe92e1ca in term 4.
I20240501 08:11:22.710206 27233 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:11:22.710485 27233 raft_consensus.cc:686] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 LEADER]: Becoming Leader. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:22.710765 27233 consensus_queue.cc:237] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.713558 26835 catalog_manager.cc:5484] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca reported cstate change: term changed from 3 to 4, leader changed from dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131) to 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129). New cstate: current_term: 4 leader_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:22.757980 27244 raft_consensus.cc:979] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:22.758162 27244 raft_consensus.cc:1067] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:22.758884 27014 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48580
I20240501 08:11:22.759100 27014 raft_consensus.cc:482] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:22.759236 27014 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.761178 27014 raft_consensus.cc:504] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.761819 27014 leader_election.cc:288] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 4 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:22.762264 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:22.762349 27087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3bee4cdc09e455c8fa5a52d947f8635" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:22.762468 26939 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.762557 27087 raft_consensus.cc:3032] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:11:22.762662 27087 raft_consensus.cc:729] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:22.762928 27087 consensus_queue.cc:260] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.763259 27087 raft_consensus.cc:3037] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:22.764663 26939 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 4.
I20240501 08:11:22.765112 26979 leader_election.cc:302] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a12aeacabdd426db6b4d523fe92e1ca, ad223d405eb642b4bce1825c85b9d368; no voters:
I20240501 08:11:22.765403 27087 raft_consensus.cc:2454] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 4.
I20240501 08:11:22.765424 27232 raft_consensus.cc:2781] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:11:22.765619 27232 raft_consensus.cc:686] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 4 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:22.765947 27232 consensus_queue.cc:237] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:22.768484 26835 catalog_manager.cc:5484] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 3 to 4, leader changed from dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 4 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:22.893404 27014 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:22.893980 27233 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:22.898085 27087 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:22.898680 27233 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:23.031481 27014 raft_consensus.cc:1261] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:23.032158 27233 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:23.035933 27087 raft_consensus.cc:1261] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:23.036984 27253 consensus_queue.cc:1035] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:23.107378 27014 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:23.108096 27253 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:23.111630 27087 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240501 08:11:23.112229 27233 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:23.126252 27014 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:23.126834 27233 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:23.130321 27087 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Refusing update from remote peer 0a12aeacabdd426db6b4d523fe92e1ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:23.131017 27233 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:23.289899 27087 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:23.290455 27232 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:23.296131 26939 raft_consensus.cc:1261] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:23.296911 27261 consensus_queue.cc:1035] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:25.342345 26326 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240501 08:11:25.342641 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:25.344988 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:40816
I20240501 08:11:25.345232 26939 raft_consensus.cc:595] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Received request to transfer leadership to TS dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:25.346189 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:40816
I20240501 08:11:25.346410 26939 raft_consensus.cc:595] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Received request to transfer leadership to TS dc38b21f6ad04ef89faab75268a00e15
I20240501 08:11:25.347220 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:40816
I20240501 08:11:25.347420 26939 raft_consensus.cc:595] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:25.348241 26939 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
mode: GRACEFUL
new_leader_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:40816
I20240501 08:11:25.348408 26939 raft_consensus.cc:595] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 LEADER]: Received request to transfer leadership to TS ad223d405eb642b4bce1825c85b9d368
I20240501 08:11:25.348776 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240501 08:11:25.348991 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:25.352115 27264 raft_consensus.cc:979] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:25.352257 27264 raft_consensus.cc:1067] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Signalling peer dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:25.352818 27088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:41216
I20240501 08:11:25.353016 27088 raft_consensus.cc:482] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:25.353148 27088 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.355799 27088 raft_consensus.cc:504] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.356526 27088 leader_election.cc:288] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 4 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:25.356973 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:25.357132 27012 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.359045 27012 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 4.
I20240501 08:11:25.359408 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "391f91c293784100af2f6ae1b0933d5c" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:25.359545 27052 leader_election.cc:302] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:25.359617 26939 raft_consensus.cc:3032] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:11:25.359710 26939 raft_consensus.cc:729] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:25.359889 27244 raft_consensus.cc:2781] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:11:25.360018 26939 consensus_queue.cc:260] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.360301 27244 raft_consensus.cc:686] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 4 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:25.360462 26939 raft_consensus.cc:3037] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.360606 27244 consensus_queue.cc:237] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.363309 26939 raft_consensus.cc:2454] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 4.
I20240501 08:11:25.363945 26837 catalog_manager.cc:5484] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 3 to 4, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 4 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:25.511350 27265 raft_consensus.cc:979] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:25.511546 27265 raft_consensus.cc:1067] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Signalling peer dc38b21f6ad04ef89faab75268a00e15 to start an election
I20240501 08:11:25.512280 27088 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f"
dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
from {username='slave'} at 127.0.0.1:41216
I20240501 08:11:25.512468 27088 raft_consensus.cc:482] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:25.512567 27088 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:25.514524 27088 raft_consensus.cc:504] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.515122 27088 leader_election.cc:288] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 2 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011)
I20240501 08:11:25.515607 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:25.515658 27012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b1246028a4e4bb19839bd2ce315dc6f" candidate_uuid: "dc38b21f6ad04ef89faab75268a00e15" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
I20240501 08:11:25.515818 26939 raft_consensus.cc:3032] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:25.515872 27012 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:25.515918 26939 raft_consensus.cc:729] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:25.516175 26939 consensus_queue.cc:260] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.516490 26939 raft_consensus.cc:3037] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:25.517984 27012 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 2.
I20240501 08:11:25.518400 27052 leader_election.cc:302] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:25.518512 26939 raft_consensus.cc:2454] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc38b21f6ad04ef89faab75268a00e15 in term 2.
I20240501 08:11:25.518687 27244 raft_consensus.cc:2781] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:25.518855 27244 raft_consensus.cc:686] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 2 LEADER]: Becoming Leader. State: Replica: dc38b21f6ad04ef89faab75268a00e15, State: Running, Role: LEADER
I20240501 08:11:25.519150 27244 consensus_queue.cc:237] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.521898 26837 catalog_manager.cc:5484] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 reported cstate change: term changed from 1 to 2, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131). New cstate: current_term: 2 leader_uuid: "dc38b21f6ad04ef89faab75268a00e15" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:25.607836 27264 raft_consensus.cc:979] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:25.607992 27264 raft_consensus.cc:1067] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:25.608671 27012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48586
I20240501 08:11:25.608871 27012 raft_consensus.cc:482] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:25.609004 27012 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.610908 27012 raft_consensus.cc:504] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.611727 27012 leader_election.cc:288] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 4 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:25.612252 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:25.612195 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "844f1fb520eb4faaa0bae6d848123554" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:25.612470 27088 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.612490 26939 raft_consensus.cc:3032] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Stepping down as leader of term 3
I20240501 08:11:25.612601 26939 raft_consensus.cc:729] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:25.612898 26939 consensus_queue.cc:260] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.613299 26939 raft_consensus.cc:3037] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Advancing to term 4
I20240501 08:11:25.615561 27088 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 4.
I20240501 08:11:25.615979 26939 raft_consensus.cc:2454] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 4.
I20240501 08:11:25.616057 26977 leader_election.cc:302] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:25.616364 27261 raft_consensus.cc:2781] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Leader election won for term 4
I20240501 08:11:25.616832 27261 raft_consensus.cc:686] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 4 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:25.617148 27261 consensus_queue.cc:237] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.619645 26837 catalog_manager.cc:5484] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 3 to 4, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 4 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:25.725693 27265 raft_consensus.cc:979] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: : Instructing follower ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:25.725867 27265 raft_consensus.cc:1067] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 LEADER]: Signalling peer ad223d405eb642b4bce1825c85b9d368 to start an election
I20240501 08:11:25.726496 27012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8c97597633db432985009e3078a7fb2b"
dest_uuid: "ad223d405eb642b4bce1825c85b9d368"
from {username='slave'} at 127.0.0.1:48586
I20240501 08:11:25.726751 27012 raft_consensus.cc:482] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240501 08:11:25.726859 27012 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:11:25.728998 27012 raft_consensus.cc:504] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.729604 27012 leader_election.cc:288] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 5 election: Requested vote from peers 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875), dc38b21f6ad04ef89faab75268a00e15 (127.25.181.131:34859)
I20240501 08:11:25.730113 26939 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0a12aeacabdd426db6b4d523fe92e1ca"
I20240501 08:11:25.730134 27088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c97597633db432985009e3078a7fb2b" candidate_uuid: "ad223d405eb642b4bce1825c85b9d368" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "dc38b21f6ad04ef89faab75268a00e15"
I20240501 08:11:25.730353 26939 raft_consensus.cc:3032] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 LEADER]: Stepping down as leader of term 4
I20240501 08:11:25.730398 27088 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:11:25.730444 26939 raft_consensus.cc:729] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0a12aeacabdd426db6b4d523fe92e1ca, State: Running, Role: LEADER
I20240501 08:11:25.730711 26939 consensus_queue.cc:260] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.731046 26939 raft_consensus.cc:3037] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Advancing to term 5
I20240501 08:11:25.732656 27088 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 5.
I20240501 08:11:25.733078 26977 leader_election.cc:302] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ad223d405eb642b4bce1825c85b9d368, dc38b21f6ad04ef89faab75268a00e15; no voters:
I20240501 08:11:25.733322 26939 raft_consensus.cc:2454] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad223d405eb642b4bce1825c85b9d368 in term 5.
I20240501 08:11:25.733407 27261 raft_consensus.cc:2781] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 5 FOLLOWER]: Leader election won for term 5
I20240501 08:11:25.733534 27261 raft_consensus.cc:686] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 5 LEADER]: Becoming Leader. State: Replica: ad223d405eb642b4bce1825c85b9d368, State: Running, Role: LEADER
I20240501 08:11:25.733850 27261 consensus_queue.cc:237] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } }
I20240501 08:11:25.736392 26837 catalog_manager.cc:5484] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 reported cstate change: term changed from 4 to 5, leader changed from 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129) to ad223d405eb642b4bce1825c85b9d368 (127.25.181.130). New cstate: current_term: 5 leader_uuid: "ad223d405eb642b4bce1825c85b9d368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:25.765961 26939 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:25.766610 27244 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:25.770960 27012 raft_consensus.cc:1261] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:25.771661 27244 consensus_queue.cc:1035] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:25.903937 26938 raft_consensus.cc:1261] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:25.904501 27244 consensus_queue.cc:1035] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:25.908824 27012 raft_consensus.cc:1261] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Refusing update from remote peer dc38b21f6ad04ef89faab75268a00e15: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:25.909435 27278 consensus_queue.cc:1035] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad223d405eb642b4bce1825c85b9d368" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 37011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:26.109943 27088 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:26.110529 27261 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:26.114326 26938 raft_consensus.cc:1261] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240501 08:11:26.115005 27273 consensus_queue.cc:1035] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:26.220083 27088 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 5 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:11:26.220697 27273 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc38b21f6ad04ef89faab75268a00e15" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 34859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:11:26.224169 26938 raft_consensus.cc:1261] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 5 FOLLOWER]: Refusing update from remote peer ad223d405eb642b4bce1825c85b9d368: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240501 08:11:26.224980 27273 consensus_queue.cc:1035] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a12aeacabdd426db6b4d523fe92e1ca" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 34875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240501 08:11:26.349349 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:26.350908 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:26.351075 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:27.351495 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:27.353143 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:27.353332 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:28.353818 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:28.355548 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:28.355738 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:29.356179 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:29.357889 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:29.358047 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:30.358520 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:30.360206 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:30.360374 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:31.360792 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:31.362478 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:31.362636 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:32.363116 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:32.365001 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:32.365196 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:33.365721 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:33.367707 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:33.367926 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:34.370170 26326 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240501 08:11:34.372337 26326 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240501 08:11:34.372612 26326 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240501 08:11:35.383235 26326 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240501 08:11:35.383481 26326 tablet_server.cc:178] TabletServer@127.25.181.129:0 shutting down...
W20240501 08:11:35.385568 26979 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20240501 08:11:35.389847 26979 consensus_peers.cc:485] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 -> Peer 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875): Couldn't send request to peer 0a12aeacabdd426db6b4d523fe92e1ca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:35.394654 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:35.394946 26326 tablet_replica.cc:330] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.395130 26326 raft_consensus.cc:2229] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.395375 26326 raft_consensus.cc:2258] T 391f91c293784100af2f6ae1b0933d5c P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.395998 26326 tablet_replica.cc:330] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.396174 26326 raft_consensus.cc:2229] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.396451 26326 raft_consensus.cc:2258] T f19daebefbb64599853b03d6ad38d5b0 P 0a12aeacabdd426db6b4d523fe92e1ca [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.396941 26326 tablet_replica.cc:330] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.397089 26326 raft_consensus.cc:2229] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.397346 26326 raft_consensus.cc:2258] T e8c020780ad645d28ac8701444ac8cf2 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.397754 26326 tablet_replica.cc:330] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.397920 26326 raft_consensus.cc:2229] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.398063 26326 raft_consensus.cc:2258] T 1b1246028a4e4bb19839bd2ce315dc6f P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.398478 26326 tablet_replica.cc:330] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.398622 26326 raft_consensus.cc:2229] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.398768 26326 raft_consensus.cc:2258] T a3bee4cdc09e455c8fa5a52d947f8635 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.399142 26326 tablet_replica.cc:330] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.399266 26326 raft_consensus.cc:2229] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.399510 26326 raft_consensus.cc:2258] T fad2da8a30c94cb5bc54f57b1cd34209 P 0a12aeacabdd426db6b4d523fe92e1ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.399940 26326 tablet_replica.cc:330] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.400048 26326 raft_consensus.cc:2229] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.400169 26326 raft_consensus.cc:2258] T 844f1fb520eb4faaa0bae6d848123554 P 0a12aeacabdd426db6b4d523fe92e1ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.400519 26326 tablet_replica.cc:330] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.400643 26326 raft_consensus.cc:2229] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.400846 26326 raft_consensus.cc:2258] T 7e9f1a0de64044988739777992f25c4d P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.401212 26326 tablet_replica.cc:330] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.401315 26326 raft_consensus.cc:2229] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.401437 26326 raft_consensus.cc:2258] T 8c97597633db432985009e3078a7fb2b P 0a12aeacabdd426db6b4d523fe92e1ca [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.401793 26326 tablet_replica.cc:330] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca: stopping tablet replica
I20240501 08:11:35.401906 26326 raft_consensus.cc:2229] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.402016 26326 raft_consensus.cc:2258] T a4d20a01457246c2a52717ecfb70f39c P 0a12aeacabdd426db6b4d523fe92e1ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20240501 08:11:35.412214 26979 consensus_peers.cc:485] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 -> Peer 0a12aeacabdd426db6b4d523fe92e1ca (127.25.181.129:34875): Couldn't send request to peer 0a12aeacabdd426db6b4d523fe92e1ca. Status: Network error: Client connection negotiation failed: client connection to 127.25.181.129:34875: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:35.427888 26326 tablet_server.cc:194] TabletServer@127.25.181.129:0 shutdown complete.
I20240501 08:11:35.432305 26326 tablet_server.cc:178] TabletServer@127.25.181.130:0 shutting down...
I20240501 08:11:35.442382 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:35.442668 26326 tablet_replica.cc:330] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.442855 26326 raft_consensus.cc:2229] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.443003 26326 raft_consensus.cc:2258] T 7e9f1a0de64044988739777992f25c4d P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.443557 26326 tablet_replica.cc:330] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.443670 26326 raft_consensus.cc:2229] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 4 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.443888 26326 raft_consensus.cc:2258] T a3bee4cdc09e455c8fa5a52d947f8635 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.444274 26326 tablet_replica.cc:330] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.444370 26326 raft_consensus.cc:2229] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 4 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.444557 26326 raft_consensus.cc:2258] T 844f1fb520eb4faaa0bae6d848123554 P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.444900 26326 tablet_replica.cc:330] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.444998 26326 raft_consensus.cc:2229] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.445087 26326 raft_consensus.cc:2258] T fad2da8a30c94cb5bc54f57b1cd34209 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.445411 26326 tablet_replica.cc:330] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.445504 26326 raft_consensus.cc:2229] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 5 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.445700 26326 raft_consensus.cc:2258] T 8c97597633db432985009e3078a7fb2b P ad223d405eb642b4bce1825c85b9d368 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.446027 26326 tablet_replica.cc:330] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.446113 26326 raft_consensus.cc:2229] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.446208 26326 raft_consensus.cc:2258] T a4d20a01457246c2a52717ecfb70f39c P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.446535 26326 tablet_replica.cc:330] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.446637 26326 raft_consensus.cc:2229] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.446731 26326 raft_consensus.cc:2258] T 1b1246028a4e4bb19839bd2ce315dc6f P ad223d405eb642b4bce1825c85b9d368 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.447065 26326 tablet_replica.cc:330] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.447152 26326 raft_consensus.cc:2229] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.447242 26326 raft_consensus.cc:2258] T e8c020780ad645d28ac8701444ac8cf2 P ad223d405eb642b4bce1825c85b9d368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.447620 26326 tablet_replica.cc:330] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.447710 26326 raft_consensus.cc:2229] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.447800 26326 raft_consensus.cc:2258] T 391f91c293784100af2f6ae1b0933d5c P ad223d405eb642b4bce1825c85b9d368 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.448125 26326 tablet_replica.cc:330] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368: stopping tablet replica
I20240501 08:11:35.448210 26326 raft_consensus.cc:2229] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.448303 26326 raft_consensus.cc:2258] T f19daebefbb64599853b03d6ad38d5b0 P ad223d405eb642b4bce1825c85b9d368 [term 3 FOLLOWER]: Raft consensus is shut down!
W20240501 08:11:35.456918 27052 consensus_peers.cc:485] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 -> Peer ad223d405eb642b4bce1825c85b9d368 (127.25.181.130:37011): Couldn't send request to peer ad223d405eb642b4bce1825c85b9d368. Status: Network error: Client connection negotiation failed: client connection to 127.25.181.130:37011: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:35.465106 26326 tablet_server.cc:194] TabletServer@127.25.181.130:0 shutdown complete.
I20240501 08:11:35.469625 26326 tablet_server.cc:178] TabletServer@127.25.181.131:0 shutting down...
I20240501 08:11:35.478919 26326 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240501 08:11:35.479233 26326 tablet_replica.cc:330] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.479481 26326 raft_consensus.cc:2229] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.479678 26326 raft_consensus.cc:2258] T a3bee4cdc09e455c8fa5a52d947f8635 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.480242 26326 tablet_replica.cc:330] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.480378 26326 raft_consensus.cc:2229] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.480525 26326 raft_consensus.cc:2258] T 844f1fb520eb4faaa0bae6d848123554 P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.480933 26326 tablet_replica.cc:330] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.481072 26326 raft_consensus.cc:2229] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.481205 26326 raft_consensus.cc:2258] T fad2da8a30c94cb5bc54f57b1cd34209 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.481614 26326 tablet_replica.cc:330] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.481745 26326 raft_consensus.cc:2229] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.481868 26326 raft_consensus.cc:2258] T 7e9f1a0de64044988739777992f25c4d P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.482272 26326 tablet_replica.cc:330] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.482409 26326 raft_consensus.cc:2229] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.482534 26326 raft_consensus.cc:2258] T e8c020780ad645d28ac8701444ac8cf2 P dc38b21f6ad04ef89faab75268a00e15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.482901 26326 tablet_replica.cc:330] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.483026 26326 raft_consensus.cc:2229] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.483315 26326 raft_consensus.cc:2258] T 1b1246028a4e4bb19839bd2ce315dc6f P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.483732 26326 tablet_replica.cc:330] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.483855 26326 raft_consensus.cc:2229] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 2 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.484093 26326 raft_consensus.cc:2258] T a4d20a01457246c2a52717ecfb70f39c P dc38b21f6ad04ef89faab75268a00e15 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.484462 26326 tablet_replica.cc:330] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.484586 26326 raft_consensus.cc:2229] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.484704 26326 raft_consensus.cc:2258] T 8c97597633db432985009e3078a7fb2b P dc38b21f6ad04ef89faab75268a00e15 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.485066 26326 tablet_replica.cc:330] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.485184 26326 raft_consensus.cc:2229] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:35.485312 26326 raft_consensus.cc:2258] T f19daebefbb64599853b03d6ad38d5b0 P dc38b21f6ad04ef89faab75268a00e15 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.485687 26326 tablet_replica.cc:330] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15: stopping tablet replica
I20240501 08:11:35.485807 26326 raft_consensus.cc:2229] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 4 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.486016 26326 raft_consensus.cc:2258] T 391f91c293784100af2f6ae1b0933d5c P dc38b21f6ad04ef89faab75268a00e15 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.502112 26326 tablet_server.cc:194] TabletServer@127.25.181.131:0 shutdown complete.
I20240501 08:11:35.506909 26326 master.cc:537] Master@127.25.181.190:45569 shutting down...
I20240501 08:11:35.515194 26326 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 1 LEADER]: Raft consensus shutting down.
I20240501 08:11:35.515487 26326 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:35.515609 26326 tablet_replica.cc:330] T 00000000000000000000000000000000 P 51b06daa8606410380eff8884b6c0749: stopping tablet replica
I20240501 08:11:35.529019 26326 master.cc:552] Master@127.25.181.190:45569 shutdown complete.
0a12aeacabdd426db6b4d523fe92e1ca 5
ad223d405eb642b4bce1825c85b9d368 4
dc38b21f6ad04ef89faab75268a00e15 1
0a12aeacabdd426db6b4d523fe92e1ca 4
ad223d405eb642b4bce1825c85b9d368 3
dc38b21f6ad04ef89faab75268a00e15 3
0a12aeacabdd426db6b4d523fe92e1ca 8
ad223d405eb642b4bce1825c85b9d368 1
dc38b21f6ad04ef89faab75268a00e15 1
0a12aeacabdd426db6b4d523fe92e1ca 4
ad223d405eb642b4bce1825c85b9d368 3
dc38b21f6ad04ef89faab75268a00e15 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27231 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240501 08:11:35.547183 26326 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.25.181.190:37997
I20240501 08:11:35.547775 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:35.551071 27296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.552155 27297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.552872 27299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:35.553771 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:35.554076 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:35.554133 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:35.554170 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551095554166 us; error 0 us; skew 500 ppm
I20240501 08:11:35.554329 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:35.555757 26326 webserver.cc:460] Webserver started at http://127.25.181.190:45463/ using document root <none> and password file <none>
I20240501 08:11:35.555989 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:35.556057 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:35.556188 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:35.557102 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/master-0-root/instance:
uuid: "45e4b79e761f4d0abf521106306760f7"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.559723 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20240501 08:11:35.561262 27304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.561605 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240501 08:11:35.561710 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/master-0-root
uuid: "45e4b79e761f4d0abf521106306760f7"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.561825 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:35.582085 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:35.582691 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:35.596536 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.190:37997
I20240501 08:11:35.596562 27355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.190:37997 every 8 connection(s)
I20240501 08:11:35.597894 27356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.601984 27356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7: Bootstrap starting.
I20240501 08:11:35.603307 27356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:35.605041 27356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7: No bootstrap required, opened a new log
I20240501 08:11:35.605651 27356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER }
I20240501 08:11:35.605775 27356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:35.605839 27356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45e4b79e761f4d0abf521106306760f7, State: Initialized, Role: FOLLOWER
I20240501 08:11:35.606027 27356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER }
I20240501 08:11:35.606135 27356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240501 08:11:35.606170 27356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240501 08:11:35.606236 27356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:35.608057 27356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER }
I20240501 08:11:35.608234 27356 leader_election.cc:302] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45e4b79e761f4d0abf521106306760f7; no voters:
I20240501 08:11:35.608618 27356 leader_election.cc:288] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240501 08:11:35.608769 27359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:35.609203 27359 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [term 1 LEADER]: Becoming Leader. State: Replica: 45e4b79e761f4d0abf521106306760f7, State: Running, Role: LEADER
I20240501 08:11:35.609447 27359 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER }
I20240501 08:11:35.609452 27356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [sys.catalog]: configured and running, proceeding with master startup.
I20240501 08:11:35.610219 27361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45e4b79e761f4d0abf521106306760f7. Latest consensus state: current_term: 1 leader_uuid: "45e4b79e761f4d0abf521106306760f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER } }
I20240501 08:11:35.610386 27360 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45e4b79e761f4d0abf521106306760f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45e4b79e761f4d0abf521106306760f7" member_type: VOTER } }
I20240501 08:11:35.610455 27361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [sys.catalog]: This master's current role is: LEADER
I20240501 08:11:35.610570 27360 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7 [sys.catalog]: This master's current role is: LEADER
I20240501 08:11:35.611857 27364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240501 08:11:35.613168 27364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240501 08:11:35.614668 26326 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240501 08:11:35.616000 27364 catalog_manager.cc:1347] Generated new cluster ID: 36ad2080ddb543bbaa2d3433184f09a5
I20240501 08:11:35.616086 27364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240501 08:11:35.622700 27364 catalog_manager.cc:1370] Generated new certificate authority record
I20240501 08:11:35.623522 27364 catalog_manager.cc:1504] Loading token signing keys...
I20240501 08:11:35.633215 27364 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 45e4b79e761f4d0abf521106306760f7: Generated new TSK 0
I20240501 08:11:35.633446 27364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240501 08:11:35.647771 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:35.651319 27377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.652329 27378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.653056 27380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:35.653990 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:35.654302 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:35.654366 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:35.654408 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551095654405 us; error 0 us; skew 500 ppm
I20240501 08:11:35.654557 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:35.655974 26326 webserver.cc:460] Webserver started at http://127.25.181.129:34991/ using document root <none> and password file <none>
I20240501 08:11:35.656190 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:35.656257 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:35.656386 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:35.657058 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/instance:
uuid: "221d03143b8c485bb23ea0460fd63c93"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.659570 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240501 08:11:35.661131 27385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.661458 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:35.661554 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root
uuid: "221d03143b8c485bb23ea0460fd63c93"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.661666 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:35.674141 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:35.674703 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:35.675382 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:35.676235 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:35.676290 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.676369 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:35.676405 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.690889 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.129:42561
I20240501 08:11:35.690917 27447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.129:42561 every 8 connection(s)
I20240501 08:11:35.692552 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:35.696198 27452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.697227 27453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.698088 27455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:35.698875 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:35.699177 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:35.699245 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:35.699298 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551095699276 us; error 0 us; skew 500 ppm
I20240501 08:11:35.699343 27448 heartbeater.cc:347] Connected to a master server at 127.25.181.190:37997
I20240501 08:11:35.699450 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:35.699450 27448 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:35.699867 27448 heartbeater.cc:511] Master 127.25.181.190:37997 requested a full tablet report, sending...
I20240501 08:11:35.700862 27321 ts_manager.cc:194] Registered new tserver with Master: 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:35.700870 26326 webserver.cc:460] Webserver started at http://127.25.181.130:46013/ using document root <none> and password file <none>
I20240501 08:11:35.701112 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:35.701184 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:35.701308 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:35.701941 27321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33790
I20240501 08:11:35.701925 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/instance:
uuid: "8547734889f841dbbbff809909a0fc3b"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.704694 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:35.706163 27460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.706527 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20240501 08:11:35.706645 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root
uuid: "8547734889f841dbbbff809909a0fc3b"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.706744 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:35.715250 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:35.715883 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:35.716470 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:35.717393 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:35.717461 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.717548 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:35.717602 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.730475 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.130:39237
I20240501 08:11:35.730495 27522 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.130:39237 every 8 connection(s)
I20240501 08:11:35.732244 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240501 08:11:35.738391 27526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:35.739589 27527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:35.740203 27523 heartbeater.cc:347] Connected to a master server at 127.25.181.190:37997
W20240501 08:11:35.740284 27529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:35.740330 27523 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:35.740780 27523 heartbeater.cc:511] Master 127.25.181.190:37997 requested a full tablet report, sending...
I20240501 08:11:35.741052 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:35.741345 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:35.741447 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:35.741495 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551095741490 us; error 0 us; skew 500 ppm
I20240501 08:11:35.741639 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:35.741744 27321 ts_manager.cc:194] Registered new tserver with Master: 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:35.742710 27321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33806
I20240501 08:11:35.743160 26326 webserver.cc:460] Webserver started at http://127.25.181.131:38467/ using document root <none> and password file <none>
I20240501 08:11:35.743413 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:35.743475 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:35.743592 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:35.744220 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/instance:
uuid: "ea3c290047e7442da83cf10d6c197e05"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.746553 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:35.748010 27534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.748332 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:35.748431 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root
uuid: "ea3c290047e7442da83cf10d6c197e05"
format_stamp: "Formatted at 2024-05-01 08:11:35 on dist-test-slave-4f6n"
I20240501 08:11:35.748531 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:35.767071 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:35.767704 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:35.768276 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:35.769106 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:35.769162 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.769237 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:35.769275 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:35.782079 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.131:39407
I20240501 08:11:35.782099 27596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.131:39407 every 8 connection(s)
I20240501 08:11:35.788805 27597 heartbeater.cc:347] Connected to a master server at 127.25.181.190:37997
I20240501 08:11:35.788929 27597 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:35.789286 27597 heartbeater.cc:511] Master 127.25.181.190:37997 requested a full tablet report, sending...
I20240501 08:11:35.790087 27321 ts_manager.cc:194] Registered new tserver with Master: ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:35.790822 27321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33814
I20240501 08:11:35.790865 26326 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00782285s
I20240501 08:11:35.791872 26326 test_util.cc:268] Using random seed: 151228669
I20240501 08:11:35.803340 27321 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33824:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240501 08:11:35.804688 27321 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240501 08:11:35.863445 27413 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8b420b6cc6452480f80e1647a96684 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 08:11:35.864056 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8b420b6cc6452480f80e1647a96684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.871023 27554 tablet_service.cc:1467] Processing CreateTablet for tablet 44e9675c2ea04bb5b611de6d2cebaab1 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 08:11:35.871253 27562 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8b420b6cc6452480f80e1647a96684 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 08:11:35.871587 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e9675c2ea04bb5b611de6d2cebaab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.871868 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8b420b6cc6452480f80e1647a96684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.875834 27561 tablet_service.cc:1467] Processing CreateTablet for tablet 198717dcedd844a5a8a9b7b2e7d29b76 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 08:11:35.876523 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198717dcedd844a5a8a9b7b2e7d29b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.879495 27560 tablet_service.cc:1467] Processing CreateTablet for tablet a04b931cea214794ae4ffef7b08f5988 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 08:11:35.880087 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04b931cea214794ae4ffef7b08f5988. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.880694 27412 tablet_service.cc:1467] Processing CreateTablet for tablet 198717dcedd844a5a8a9b7b2e7d29b76 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 08:11:35.881093 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198717dcedd844a5a8a9b7b2e7d29b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.883780 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d85013bac4c29ad870792bd90ee7f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 08:11:35.884320 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d85013bac4c29ad870792bd90ee7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.887850 27412 tablet_service.cc:1467] Processing CreateTablet for tablet a04b931cea214794ae4ffef7b08f5988 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 08:11:35.887794 27558 tablet_service.cc:1467] Processing CreateTablet for tablet 70989ab91fe5428f8eef03dc9ba62cc0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 08:11:35.888214 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04b931cea214794ae4ffef7b08f5988. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.888355 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70989ab91fe5428f8eef03dc9ba62cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.891556 27557 tablet_service.cc:1467] Processing CreateTablet for tablet b0c3bc1b2a504bc587e2729085b3618b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 08:11:35.892019 27411 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d85013bac4c29ad870792bd90ee7f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 08:11:35.892256 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0c3bc1b2a504bc587e2729085b3618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.892421 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d85013bac4c29ad870792bd90ee7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.895787 27556 tablet_service.cc:1467] Processing CreateTablet for tablet f9e42523487740e6a1df02db3a644215 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 08:11:35.896448 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e42523487740e6a1df02db3a644215. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.899760 27555 tablet_service.cc:1467] Processing CreateTablet for tablet 86aa978719c344bca120402ae173afdc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 08:11:35.900141 27409 tablet_service.cc:1467] Processing CreateTablet for tablet b0c3bc1b2a504bc587e2729085b3618b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 08:11:35.900406 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86aa978719c344bca120402ae173afdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.900686 27409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0c3bc1b2a504bc587e2729085b3618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.899755 27410 tablet_service.cc:1467] Processing CreateTablet for tablet 70989ab91fe5428f8eef03dc9ba62cc0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 08:11:35.901460 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70989ab91fe5428f8eef03dc9ba62cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.903802 27407 tablet_service.cc:1467] Processing CreateTablet for tablet 86aa978719c344bca120402ae173afdc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 08:11:35.904397 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86aa978719c344bca120402ae173afdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.907815 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 44e9675c2ea04bb5b611de6d2cebaab1 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 08:11:35.908293 27553 tablet_service.cc:1467] Processing CreateTablet for tablet 8d545eb1aba64bdfba55e84f51514fa4 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 08:11:35.908735 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d545eb1aba64bdfba55e84f51514fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.915961 27553 tablet_service.cc:1467] Processing CreateTablet for tablet c82fe72d61c3422da54771ab3d3b0325 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 08:11:35.917955 27412 tablet_service.cc:1467] Processing CreateTablet for tablet c82fe72d61c3422da54771ab3d3b0325 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 08:11:35.918257 27408 tablet_service.cc:1467] Processing CreateTablet for tablet f9e42523487740e6a1df02db3a644215 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 08:11:35.918985 27405 tablet_service.cc:1467] Processing CreateTablet for tablet 8d545eb1aba64bdfba55e84f51514fa4 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 08:11:35.917955 27404 tablet_service.cc:1467] Processing CreateTablet for tablet 2d93678464084b9884fd9eb4c2659ff6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 08:11:35.908394 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e9675c2ea04bb5b611de6d2cebaab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.920375 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fe72d61c3422da54771ab3d3b0325. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.921440 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e42523487740e6a1df02db3a644215. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.921761 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fe72d61c3422da54771ab3d3b0325. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.912988 27555 tablet_service.cc:1467] Processing CreateTablet for tablet 2d93678464084b9884fd9eb4c2659ff6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 08:11:35.924331 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d93678464084b9884fd9eb4c2659ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.925115 27612 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:35.925026 27557 tablet_service.cc:1467] Processing CreateTablet for tablet ba41d287ba2a41b39b92d0ef8013d7e6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 08:11:35.925192 27554 tablet_service.cc:1467] Processing CreateTablet for tablet 55af818a67e6497ebfb9d17139081e95 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 08:11:35.925348 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d545eb1aba64bdfba55e84f51514fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.930384 27613 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:35.930563 27413 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 08:11:35.930784 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55af818a67e6497ebfb9d17139081e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.930917 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.931617 27410 tablet_service.cc:1467] Processing CreateTablet for tablet 55af818a67e6497ebfb9d17139081e95 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 08:11:35.931617 27411 tablet_service.cc:1467] Processing CreateTablet for tablet ba41d287ba2a41b39b92d0ef8013d7e6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 08:11:35.932183 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba41d287ba2a41b39b92d0ef8013d7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.935262 27407 tablet_service.cc:1467] Processing CreateTablet for tablet 8c323e11ee98466ca9267923970d59a3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 08:11:35.936947 27613 tablet_bootstrap.cc:654] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:35.937444 27612 tablet_bootstrap.cc:654] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:35.940109 27556 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 08:11:35.940522 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.940615 27612 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:35.940763 27612 ts_tablet_manager.cc:1367] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20240501 08:11:35.941355 27561 tablet_service.cc:1467] Processing CreateTablet for tablet 8c323e11ee98466ca9267923970d59a3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 08:11:35.941509 27612 raft_consensus.cc:348] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:35.941712 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c323e11ee98466ca9267923970d59a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.941712 27612 raft_consensus.cc:374] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:35.942174 27612 raft_consensus.cc:729] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:35.942414 27612 consensus_queue.cc:260] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:35.943346 27613 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:35.943634 27613 ts_tablet_manager.cc:1367] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s
I20240501 08:11:35.943806 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 11ad813120804c88ac5c8f7b08b21c84 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 08:11:35.944222 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ad813120804c88ac5c8f7b08b21c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.944530 27613 raft_consensus.cc:348] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:35.944708 27613 raft_consensus.cc:374] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:35.944765 27613 raft_consensus.cc:729] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:35.944958 27613 consensus_queue.cc:260] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:35.945922 27613 ts_tablet_manager.cc:1398] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:35.946210 27613 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:35.947485 27448 heartbeater.cc:503] Master 127.25.181.190:37997 was elected leader, sending a full tablet report...
I20240501 08:11:35.956539 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d93678464084b9884fd9eb4c2659ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.956735 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba41d287ba2a41b39b92d0ef8013d7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.957100 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c323e11ee98466ca9267923970d59a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.957278 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55af818a67e6497ebfb9d17139081e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.951196 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 9f924880fbff49f6a9bb7a1397a77963 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 08:11:35.960654 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f924880fbff49f6a9bb7a1397a77963. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.961381 27616 raft_consensus.cc:482] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:35.967041 27408 tablet_service.cc:1467] Processing CreateTablet for tablet 11ad813120804c88ac5c8f7b08b21c84 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 08:11:35.967769 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ad813120804c88ac5c8f7b08b21c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.969166 27612 ts_tablet_manager.cc:1398] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.028s user 0.013s sys 0.000s
I20240501 08:11:35.969403 27597 heartbeater.cc:503] Master 127.25.181.190:37997 was elected leader, sending a full tablet report...
I20240501 08:11:35.969451 27612 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:35.972385 27487 tablet_service.cc:1467] Processing CreateTablet for tablet 198717dcedd844a5a8a9b7b2e7d29b76 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240501 08:11:35.972939 27485 tablet_service.cc:1467] Processing CreateTablet for tablet 6f0d85013bac4c29ad870792bd90ee7f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240501 08:11:35.975344 27560 tablet_service.cc:1467] Processing CreateTablet for tablet f678d6771a8a4b47bc5d3523bef952e5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 08:11:35.976054 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 198717dcedd844a5a8a9b7b2e7d29b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.974385 27486 tablet_service.cc:1467] Processing CreateTablet for tablet a04b931cea214794ae4ffef7b08f5988 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240501 08:11:35.978595 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f678d6771a8a4b47bc5d3523bef952e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.979751 27558 tablet_service.cc:1467] Processing CreateTablet for tablet b509576adf3c4e2c817f12d3fac6f72b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 08:11:35.980186 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f0d85013bac4c29ad870792bd90ee7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.981040 27488 tablet_service.cc:1467] Processing CreateTablet for tablet 8a8b420b6cc6452480f80e1647a96684 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240501 08:11:35.979244 27482 tablet_service.cc:1467] Processing CreateTablet for tablet f9e42523487740e6a1df02db3a644215 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240501 08:11:35.981417 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b509576adf3c4e2c817f12d3fac6f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.983021 27480 tablet_service.cc:1467] Processing CreateTablet for tablet 44e9675c2ea04bb5b611de6d2cebaab1 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240501 08:11:35.983230 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a04b931cea214794ae4ffef7b08f5988. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.984329 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9e42523487740e6a1df02db3a644215. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.962538 27616 raft_consensus.cc:504] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:35.988544 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a8b420b6cc6452480f80e1647a96684. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.997534 27480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e9675c2ea04bb5b611de6d2cebaab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:35.997538 27481 tablet_service.cc:1467] Processing CreateTablet for tablet 86aa978719c344bca120402ae173afdc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240501 08:11:35.995404 27484 tablet_service.cc:1467] Processing CreateTablet for tablet 70989ab91fe5428f8eef03dc9ba62cc0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240501 08:11:35.999464 27483 tablet_service.cc:1467] Processing CreateTablet for tablet b0c3bc1b2a504bc587e2729085b3618b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240501 08:11:36.002642 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86aa978719c344bca120402ae173afdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.003489 27616 leader_election.cc:288] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.003664 27562 tablet_service.cc:1467] Processing CreateTablet for tablet ff6df2ff96c6444bb8b2d8d01065148c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 08:11:36.012076 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70989ab91fe5428f8eef03dc9ba62cc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.012570 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6df2ff96c6444bb8b2d8d01065148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.001732 27479 tablet_service.cc:1467] Processing CreateTablet for tablet 8d545eb1aba64bdfba55e84f51514fa4 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240501 08:11:36.015794 27412 tablet_service.cc:1467] Processing CreateTablet for tablet 9f924880fbff49f6a9bb7a1397a77963 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 08:11:36.017501 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0c3bc1b2a504bc587e2729085b3618b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.020324 27613 tablet_bootstrap.cc:654] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.020591 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f924880fbff49f6a9bb7a1397a77963. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.024008 27554 tablet_service.cc:1467] Processing CreateTablet for tablet 1583f6f65abf4411a937349cff09bb6b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 08:11:36.025532 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1583f6f65abf4411a937349cff09bb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.026728 27409 tablet_service.cc:1467] Processing CreateTablet for tablet f678d6771a8a4b47bc5d3523bef952e5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 08:11:36.034232 27479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d545eb1aba64bdfba55e84f51514fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.036587 27409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f678d6771a8a4b47bc5d3523bef952e5. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.043327 27598 tablet.cc:2369] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240501 08:11:36.049674 27612 tablet_bootstrap.cc:654] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.053884 27405 tablet_service.cc:1467] Processing CreateTablet for tablet b509576adf3c4e2c817f12d3fac6f72b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 08:11:36.056699 27413 tablet_service.cc:1467] Processing CreateTablet for tablet ff6df2ff96c6444bb8b2d8d01065148c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 08:11:36.059768 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b509576adf3c4e2c817f12d3fac6f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.064493 27553 tablet_service.cc:1467] Processing CreateTablet for tablet 200c3f11ec194af394c1c130d22a9663 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 08:11:36.065301 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6df2ff96c6444bb8b2d8d01065148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.068091 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200c3f11ec194af394c1c130d22a9663. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.077158 27617 raft_consensus.cc:482] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.078472 27557 tablet_service.cc:1467] Processing CreateTablet for tablet 6615e3386cc24130a48c758a6e3064dd (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 08:11:36.081032 27407 tablet_service.cc:1467] Processing CreateTablet for tablet 1583f6f65abf4411a937349cff09bb6b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 08:11:36.082943 27404 tablet_service.cc:1467] Processing CreateTablet for tablet 200c3f11ec194af394c1c130d22a9663 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 08:11:36.083104 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6615e3386cc24130a48c758a6e3064dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.085548 27613 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.086202 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1583f6f65abf4411a937349cff09bb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.080447 27617 raft_consensus.cc:504] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.091751 27561 tablet_service.cc:1467] Processing CreateTablet for tablet 6d891a5adbb24e6293e0303b656ddc5a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 08:11:36.091477 27613 ts_tablet_manager.cc:1367] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.140s user 0.009s sys 0.006s
I20240501 08:11:36.094291 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d891a5adbb24e6293e0303b656ddc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.094833 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200c3f11ec194af394c1c130d22a9663. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.099980 27617 leader_election.cc:288] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.100261 27411 tablet_service.cc:1467] Processing CreateTablet for tablet 6d891a5adbb24e6293e0303b656ddc5a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 08:11:36.100900 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d891a5adbb24e6293e0303b656ddc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.101819 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 08:11:36.102393 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac20effe8284a15b83bc3fd1a72d8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.103893 27410 tablet_service.cc:1467] Processing CreateTablet for tablet 6615e3386cc24130a48c758a6e3064dd (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 08:11:36.099792 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.112903 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6615e3386cc24130a48c758a6e3064dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.120682 27387 leader_election.cc:341] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.120998 27555 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240501 08:11:36.121574 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac20effe8284a15b83bc3fd1a72d8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.126658 27613 raft_consensus.cc:348] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.128170 27613 raft_consensus.cc:374] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.128305 27613 raft_consensus.cc:729] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.139578 27612 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.141280 27612 ts_tablet_manager.cc:1367] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.170s user 0.008s sys 0.020s
I20240501 08:11:36.141853 27486 tablet_service.cc:1467] Processing CreateTablet for tablet c82fe72d61c3422da54771ab3d3b0325 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240501 08:11:36.142385 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c82fe72d61c3422da54771ab3d3b0325. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.142253 27612 raft_consensus.cc:348] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.142516 27612 raft_consensus.cc:374] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.142621 27612 raft_consensus.cc:729] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.142889 27612 consensus_queue.cc:260] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.146126 27488 tablet_service.cc:1467] Processing CreateTablet for tablet 2d93678464084b9884fd9eb4c2659ff6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240501 08:11:36.146575 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d93678464084b9884fd9eb4c2659ff6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.146937 27556 tablet_service.cc:1467] Processing CreateTablet for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 08:11:36.147307 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.149577 27613 consensus_queue.cc:260] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.157184 27616 raft_consensus.cc:482] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.161038 27560 tablet_service.cc:1467] Processing CreateTablet for tablet a99b775bfcce42cead10cc95ceff2174 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 08:11:36.166062 27408 tablet_service.cc:1467] Processing CreateTablet for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 08:11:36.166038 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99b775bfcce42cead10cc95ceff2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.166611 27612 ts_tablet_manager.cc:1398] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20240501 08:11:36.170735 27616 raft_consensus.cc:504] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.174448 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.175032 27487 tablet_service.cc:1467] Processing CreateTablet for tablet ba41d287ba2a41b39b92d0ef8013d7e6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240501 08:11:36.178145 27485 tablet_service.cc:1467] Processing CreateTablet for tablet 55af818a67e6497ebfb9d17139081e95 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240501 08:11:36.179198 27482 tablet_service.cc:1467] Processing CreateTablet for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240501 08:11:36.186172 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba41d287ba2a41b39b92d0ef8013d7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.186666 27612 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.190285 27613 ts_tablet_manager.cc:1398] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.085s user 0.004s sys 0.001s
I20240501 08:11:36.193341 27616 leader_election.cc:288] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.194201 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.195212 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a5bbccb6bb04e94bd6d3c7a48ef810e. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.198071 27387 leader_election.cc:341] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.200559 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55af818a67e6497ebfb9d17139081e95. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.201434 27613 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.201483 27623 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.201292 27480 tablet_service.cc:1467] Processing CreateTablet for tablet 8c323e11ee98466ca9267923970d59a3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240501 08:11:36.202658 27558 tablet_service.cc:1467] Processing CreateTablet for tablet eb7f1d58a88745faa02205086a758098 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 08:11:36.203600 27481 tablet_service.cc:1467] Processing CreateTablet for tablet 11ad813120804c88ac5c8f7b08b21c84 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240501 08:11:36.204753 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11ad813120804c88ac5c8f7b08b21c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.204838 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.207891 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7f1d58a88745faa02205086a758098. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.208324 27480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c323e11ee98466ca9267923970d59a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.208425 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:36.217087 27389 leader_election.cc:341] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.218339 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 788dbb1243e348eaacdedb75aefa7691 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 08:11:36.219077 27562 tablet_service.cc:1467] Processing CreateTablet for tablet 2342377b202a4bfa97e58ee217f56bcc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 08:11:36.220149 27612 tablet_bootstrap.cc:654] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.220742 27389 leader_election.cc:302] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:36.221666 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 788dbb1243e348eaacdedb75aefa7691. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.222508 27624 raft_consensus.cc:2726] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20240501 08:11:36.222546 27389 leader_election.cc:341] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.222685 27389 leader_election.cc:302] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:36.222940 27624 raft_consensus.cc:2726] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.227383 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2342377b202a4bfa97e58ee217f56bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.230544 27484 tablet_service.cc:1467] Processing CreateTablet for tablet 9f924880fbff49f6a9bb7a1397a77963 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240501 08:11:36.239903 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f924880fbff49f6a9bb7a1397a77963. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.235131 27412 tablet_service.cc:1467] Processing CreateTablet for tablet a99b775bfcce42cead10cc95ceff2174 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 08:11:36.244485 27483 tablet_service.cc:1467] Processing CreateTablet for tablet f678d6771a8a4b47bc5d3523bef952e5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240501 08:11:36.244424 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.246181 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99b775bfcce42cead10cc95ceff2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.246699 27554 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1fd9ea5e73497fbc56acc71dade295 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 08:11:36.248435 27613 tablet_bootstrap.cc:654] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.248687 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f678d6771a8a4b47bc5d3523bef952e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.249756 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1fd9ea5e73497fbc56acc71dade295. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.250355 27409 tablet_service.cc:1467] Processing CreateTablet for tablet eb7f1d58a88745faa02205086a758098 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 08:11:36.253358 27409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7f1d58a88745faa02205086a758098. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.253224 27537 leader_election.cc:341] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.255563 27479 tablet_service.cc:1467] Processing CreateTablet for tablet b509576adf3c4e2c817f12d3fac6f72b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240501 08:11:36.255962 27623 tablet_bootstrap.cc:654] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.263027 27479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b509576adf3c4e2c817f12d3fac6f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.266873 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 788dbb1243e348eaacdedb75aefa7691 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 08:11:36.273099 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 788dbb1243e348eaacdedb75aefa7691. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.275522 27557 tablet_service.cc:1467] Processing CreateTablet for tablet a2a4436843d54143b8c8d45ce309ca36 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 08:11:36.277818 27413 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1fd9ea5e73497fbc56acc71dade295 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 08:11:36.277848 27404 tablet_service.cc:1467] Processing CreateTablet for tablet a2a4436843d54143b8c8d45ce309ca36 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 08:11:36.281183 27407 tablet_service.cc:1467] Processing CreateTablet for tablet 2342377b202a4bfa97e58ee217f56bcc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 08:11:36.281544 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a4436843d54143b8c8d45ce309ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.286942 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1fd9ea5e73497fbc56acc71dade295. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.291960 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2342377b202a4bfa97e58ee217f56bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.293740 27561 tablet_service.cc:1467] Processing CreateTablet for tablet b078e697a866402083f8b9b79695016b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 08:11:36.295042 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a4436843d54143b8c8d45ce309ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.296939 27553 tablet_service.cc:1467] Processing CreateTablet for tablet a751f6bbfc764eac871066bee792832c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 08:11:36.297828 27405 tablet_service.cc:1467] Processing CreateTablet for tablet b078e697a866402083f8b9b79695016b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 08:11:36.299065 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078e697a866402083f8b9b79695016b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.299603 27411 tablet_service.cc:1467] Processing CreateTablet for tablet a751f6bbfc764eac871066bee792832c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 08:11:36.299610 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a751f6bbfc764eac871066bee792832c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.302320 27555 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca8b6207ad64e53afc74b488e8eea32 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 08:11:36.302668 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca8b6207ad64e53afc74b488e8eea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.305168 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078e697a866402083f8b9b79695016b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.305379 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a751f6bbfc764eac871066bee792832c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.313321 27556 tablet_service.cc:1467] Processing CreateTablet for tablet c6b91c6bda24445c8a0ec60f77733af6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 08:11:36.313911 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b91c6bda24445c8a0ec60f77733af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.322266 27612 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.322536 27612 ts_tablet_manager.cc:1367] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.155s user 0.021s sys 0.012s
I20240501 08:11:36.325474 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:36.326083 27538 leader_election.cc:341] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.326190 27538 leader_election.cc:302] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:36.328370 27486 tablet_service.cc:1467] Processing CreateTablet for tablet ff6df2ff96c6444bb8b2d8d01065148c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240501 08:11:36.328822 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6df2ff96c6444bb8b2d8d01065148c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.329273 27617 raft_consensus.cc:2726] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.334102 27488 tablet_service.cc:1467] Processing CreateTablet for tablet 1583f6f65abf4411a937349cff09bb6b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240501 08:11:36.335179 27410 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca8b6207ad64e53afc74b488e8eea32 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 08:11:36.335819 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca8b6207ad64e53afc74b488e8eea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.337100 27613 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.337244 27613 ts_tablet_manager.cc:1367] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.136s user 0.011s sys 0.019s
I20240501 08:11:36.338428 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1583f6f65abf4411a937349cff09bb6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.340030 27482 tablet_service.cc:1467] Processing CreateTablet for tablet 200c3f11ec194af394c1c130d22a9663 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240501 08:11:36.341379 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200c3f11ec194af394c1c130d22a9663. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.338935 27412 tablet_service.cc:1467] Processing CreateTablet for tablet c6b91c6bda24445c8a0ec60f77733af6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 08:11:36.342386 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b91c6bda24445c8a0ec60f77733af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.342084 27613 raft_consensus.cc:348] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.343222 27613 raft_consensus.cc:374] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.343315 27613 raft_consensus.cc:729] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.348174 27480 tablet_service.cc:1467] Processing CreateTablet for tablet 6615e3386cc24130a48c758a6e3064dd (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240501 08:11:36.348814 27480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6615e3386cc24130a48c758a6e3064dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.348704 27612 raft_consensus.cc:348] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.348999 27612 raft_consensus.cc:374] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.349069 27612 raft_consensus.cc:729] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.349411 27612 consensus_queue.cc:260] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.350308 27612 ts_tablet_manager.cc:1398] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20240501 08:11:36.350682 27612 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.354795 27562 tablet_service.cc:1467] Processing CreateTablet for tablet b8aff03771b047a991c020cc628aa057 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 08:11:36.355449 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8aff03771b047a991c020cc628aa057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.355643 27487 tablet_service.cc:1467] Processing CreateTablet for tablet 6d891a5adbb24e6293e0303b656ddc5a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240501 08:11:36.356125 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d891a5adbb24e6293e0303b656ddc5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.357409 27613 consensus_queue.cc:260] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.359464 27613 ts_tablet_manager.cc:1398] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.022s user 0.000s sys 0.003s
I20240501 08:11:36.359841 27613 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.361883 27624 raft_consensus.cc:482] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.364377 27556 tablet_service.cc:1467] Processing CreateTablet for tablet e121a0b28dc14dec962f98efc3f08137 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 08:11:36.362051 27624 raft_consensus.cc:504] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.366408 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e121a0b28dc14dec962f98efc3f08137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.374734 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.374842 27485 tablet_service.cc:1467] Processing CreateTablet for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20240501 08:11:36.375257 27389 leader_election.cc:341] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.375515 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac20effe8284a15b83bc3fd1a72d8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.379686 27483 tablet_service.cc:1467] Processing CreateTablet for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240501 08:11:36.380101 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.382153 27554 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ccea69adc48058e2f17dd9901eb8a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 08:11:36.382546 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ccea69adc48058e2f17dd9901eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.382269 27407 tablet_service.cc:1467] Processing CreateTablet for tablet b8aff03771b047a991c020cc628aa057 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 08:11:36.383873 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8aff03771b047a991c020cc628aa057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.385927 27557 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08b926bac4fc5aac71cf5d27404f3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 08:11:36.386299 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08b926bac4fc5aac71cf5d27404f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.387411 27617 raft_consensus.cc:482] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.387537 27617 raft_consensus.cc:504] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.388168 27617 leader_election.cc:288] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.388662 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.388772 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
W20240501 08:11:36.389120 27538 leader_election.cc:341] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:36.389283 27537 leader_election.cc:341] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.389364 27537 leader_election.cc:302] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:36.390175 27617 raft_consensus.cc:2726] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.390834 27553 tablet_service.cc:1467] Processing CreateTablet for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 08:11:36.391223 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.391153 27405 tablet_service.cc:1467] Processing CreateTablet for tablet e121a0b28dc14dec962f98efc3f08137 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 08:11:36.391407 27624 leader_election.cc:288] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.391793 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.391991 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e121a0b28dc14dec962f98efc3f08137. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.392238 27387 leader_election.cc:341] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.392354 27387 leader_election.cc:302] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:36.392846 27624 raft_consensus.cc:2726] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.393169 27623 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.393335 27623 ts_tablet_manager.cc:1367] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.192s user 0.010s sys 0.026s
I20240501 08:11:36.393380 27484 tablet_service.cc:1467] Processing CreateTablet for tablet a99b775bfcce42cead10cc95ceff2174 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240501 08:11:36.394308 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a99b775bfcce42cead10cc95ceff2174. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.395439 27558 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb611f9eafc4e109c6d0989d6c409e9 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 08:11:36.395898 27560 tablet_service.cc:1467] Processing CreateTablet for tablet 739e5b2ab7a64581b57f3e9b0e58e87c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 08:11:36.393862 27479 tablet_service.cc:1467] Processing CreateTablet for tablet eb7f1d58a88745faa02205086a758098 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240501 08:11:36.397423 27408 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08b926bac4fc5aac71cf5d27404f3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 08:11:36.397668 27479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb7f1d58a88745faa02205086a758098. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.397825 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08b926bac4fc5aac71cf5d27404f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.399506 27613 tablet_bootstrap.cc:654] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.402823 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb611f9eafc4e109c6d0989d6c409e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.403705 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739e5b2ab7a64581b57f3e9b0e58e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.393862 27409 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ccea69adc48058e2f17dd9901eb8a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 08:11:36.404659 27409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ccea69adc48058e2f17dd9901eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.404778 27481 tablet_service.cc:1467] Processing CreateTablet for tablet 788dbb1243e348eaacdedb75aefa7691 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240501 08:11:36.408828 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 788dbb1243e348eaacdedb75aefa7691. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.408828 27413 tablet_service.cc:1467] Processing CreateTablet for tablet 739e5b2ab7a64581b57f3e9b0e58e87c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 08:11:36.409279 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739e5b2ab7a64581b57f3e9b0e58e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.409384 27405 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb611f9eafc4e109c6d0989d6c409e9 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 08:11:36.409720 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb611f9eafc4e109c6d0989d6c409e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.412222 27407 tablet_service.cc:1467] Processing CreateTablet for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 08:11:36.412690 27407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.413899 27410 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3e2c9d80984b2bacd3b622142ff06f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 08:11:36.415266 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3e2c9d80984b2bacd3b622142ff06f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 08:11:36.415351 27484 tablet_service.cc:1467] Processing CreateTablet for tablet 9d1fd9ea5e73497fbc56acc71dade295 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240501 08:11:36.415676 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3e2c9d80984b2bacd3b622142ff06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.417209 27488 tablet_service.cc:1467] Processing CreateTablet for tablet a2a4436843d54143b8c8d45ce309ca36 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240501 08:11:36.417526 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2a4436843d54143b8c8d45ce309ca36. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.418025 27404 tablet_service.cc:1467] Processing CreateTablet for tablet 6e87b258f8974e47a9ce6295482b0538 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 08:11:36.418352 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3e2c9d80984b2bacd3b622142ff06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.420461 27411 tablet_service.cc:1467] Processing CreateTablet for tablet ae61fd4c429647b5930c7b71766a94e2 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 08:11:36.420717 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e87b258f8974e47a9ce6295482b0538. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.420913 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae61fd4c429647b5930c7b71766a94e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.422632 27623 raft_consensus.cc:348] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.422839 27623 raft_consensus.cc:374] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.422904 27623 raft_consensus.cc:729] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.423097 27562 tablet_service.cc:1467] Processing CreateTablet for tablet 6e87b258f8974e47a9ce6295482b0538 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 08:11:36.423475 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e87b258f8974e47a9ce6295482b0538. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.423965 27612 tablet_bootstrap.cc:654] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.423117 27483 tablet_service.cc:1467] Processing CreateTablet for tablet 2342377b202a4bfa97e58ee217f56bcc (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240501 08:11:36.426249 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2342377b202a4bfa97e58ee217f56bcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.426445 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d1fd9ea5e73497fbc56acc71dade295. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.427052 27479 tablet_service.cc:1467] Processing CreateTablet for tablet b078e697a866402083f8b9b79695016b (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240501 08:11:36.425489 27623 consensus_queue.cc:260] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.434204 27479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078e697a866402083f8b9b79695016b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.442775 27623 ts_tablet_manager.cc:1398] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.041s user 0.006s sys 0.011s
I20240501 08:11:36.443079 27523 heartbeater.cc:503] Master 127.25.181.190:37997 was elected leader, sending a full tablet report...
I20240501 08:11:36.443172 27623 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.450387 27408 tablet_service.cc:1467] Processing CreateTablet for tablet beef83ab3d784309ab81be0edf2cc501 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 08:11:36.451781 27623 tablet_bootstrap.cc:654] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.451821 27408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beef83ab3d784309ab81be0edf2cc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.466188 27555 tablet_service.cc:1467] Processing CreateTablet for tablet ae61fd4c429647b5930c7b71766a94e2 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 08:11:36.473876 27556 tablet_service.cc:1467] Processing CreateTablet for tablet beef83ab3d784309ab81be0edf2cc501 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 08:11:36.474301 27556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beef83ab3d784309ab81be0edf2cc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.477034 27405 tablet_service.cc:1467] Processing CreateTablet for tablet bac1e15e326d46caa81b84339ab3b9fa (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 08:11:36.477386 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac1e15e326d46caa81b84339ab3b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.483465 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae61fd4c429647b5930c7b71766a94e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.486331 27406 tablet_service.cc:1467] Processing CreateTablet for tablet 44c134f2aacd4ec0b28877d654a63634 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 08:11:36.486853 27406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c134f2aacd4ec0b28877d654a63634. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.494745 27413 tablet_service.cc:1467] Processing CreateTablet for tablet d391d2e046644170902ab1c13b99bc20 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 08:11:36.495308 27413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391d2e046644170902ab1c13b99bc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.498157 27562 tablet_service.cc:1467] Processing CreateTablet for tablet bac1e15e326d46caa81b84339ab3b9fa (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 08:11:36.498677 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac1e15e326d46caa81b84339ab3b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.505515 27561 tablet_service.cc:1467] Processing CreateTablet for tablet 44c134f2aacd4ec0b28877d654a63634 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 08:11:36.505936 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c134f2aacd4ec0b28877d654a63634. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.509712 27557 tablet_service.cc:1467] Processing CreateTablet for tablet d391d2e046644170902ab1c13b99bc20 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 08:11:36.510221 27557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391d2e046644170902ab1c13b99bc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.511898 27612 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.512074 27612 ts_tablet_manager.cc:1367] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.161s user 0.011s sys 0.001s
I20240501 08:11:36.513131 27612 raft_consensus.cc:348] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.513410 27612 raft_consensus.cc:374] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.513487 27612 raft_consensus.cc:729] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.513775 27612 consensus_queue.cc:260] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.514055 27409 tablet_service.cc:1467] Processing CreateTablet for tablet 1f7cfadebf624d81b6e1f5ded8397a19 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 08:11:36.514422 27409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f7cfadebf624d81b6e1f5ded8397a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.514518 27612 ts_tablet_manager.cc:1398] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:36.514873 27612 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.515489 27485 tablet_service.cc:1467] Processing CreateTablet for tablet a751f6bbfc764eac871066bee792832c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240501 08:11:36.516767 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a751f6bbfc764eac871066bee792832c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.516368 27410 tablet_service.cc:1467] Processing CreateTablet for tablet cada09f967514de596b2d1e25598729e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 08:11:36.516057 27411 tablet_service.cc:1467] Processing CreateTablet for tablet cf58f5006691429cbd87172f4398e9c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 08:11:36.538803 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada09f967514de596b2d1e25598729e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.539191 27404 tablet_service.cc:1467] Processing CreateTablet for tablet fdc5538831434a728aa68ffc27f288e0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 08:11:36.539348 27411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf58f5006691429cbd87172f4398e9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.539709 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc5538831434a728aa68ffc27f288e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.524432 27623 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.524937 27412 tablet_service.cc:1467] Processing CreateTablet for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 08:11:36.545840 27623 ts_tablet_manager.cc:1367] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.103s user 0.026s sys 0.041s
I20240501 08:11:36.545979 27412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.546614 27623 raft_consensus.cc:348] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.546851 27623 raft_consensus.cc:374] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.546782 27404 tablet_service.cc:1467] Processing CreateTablet for tablet 758428df9488427c92435892def3d4fe (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 08:11:36.546933 27623 raft_consensus.cc:729] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.527068 27560 tablet_service.cc:1467] Processing CreateTablet for tablet cada09f967514de596b2d1e25598729e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 08:11:36.547322 27560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada09f967514de596b2d1e25598729e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.547185 27623 consensus_queue.cc:260] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.547884 27623 ts_tablet_manager.cc:1398] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:36.529399 27554 tablet_service.cc:1467] Processing CreateTablet for tablet 1f7cfadebf624d81b6e1f5ded8397a19 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 08:11:36.548171 27623 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.548336 27554 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f7cfadebf624d81b6e1f5ded8397a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.525697 27480 tablet_service.cc:1467] Processing CreateTablet for tablet 6ca8b6207ad64e53afc74b488e8eea32 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240501 08:11:36.527679 27487 tablet_service.cc:1467] Processing CreateTablet for tablet c6b91c6bda24445c8a0ec60f77733af6 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240501 08:11:36.531770 27553 tablet_service.cc:1467] Processing CreateTablet for tablet cf58f5006691429cbd87172f4398e9c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 08:11:36.532150 27488 tablet_service.cc:1467] Processing CreateTablet for tablet cd5ccea69adc48058e2f17dd9901eb8a (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240501 08:11:36.548977 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6b91c6bda24445c8a0ec60f77733af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.549216 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ccea69adc48058e2f17dd9901eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.548977 27553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf58f5006691429cbd87172f4398e9c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.550192 27410 tablet_service.cc:1467] Processing CreateTablet for tablet a53c3300b338440eafaf8027a46fb3e3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 08:11:36.531018 27481 tablet_service.cc:1467] Processing CreateTablet for tablet e121a0b28dc14dec962f98efc3f08137 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240501 08:11:36.550587 27410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53c3300b338440eafaf8027a46fb3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.535773 27612 tablet_bootstrap.cc:654] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.536917 27561 tablet_service.cc:1467] Processing CreateTablet for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 08:11:36.550715 27480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ca8b6207ad64e53afc74b488e8eea32. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.537756 27559 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb4b579b3d14e43917e295ee61142a5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 08:11:36.550930 27561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.530607 27486 tablet_service.cc:1467] Processing CreateTablet for tablet b8aff03771b047a991c020cc628aa057 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240501 08:11:36.551122 27559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb4b579b3d14e43917e295ee61142a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.538304 27558 tablet_service.cc:1467] Processing CreateTablet for tablet fdc5538831434a728aa68ffc27f288e0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 08:11:36.537361 27482 tablet_service.cc:1467] Processing CreateTablet for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240501 08:11:36.551589 27558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc5538831434a728aa68ffc27f288e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.534327 27484 tablet_service.cc:1467] Processing CreateTablet for tablet 18d08b926bac4fc5aac71cf5d27404f3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240501 08:11:36.537950 27405 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb4b579b3d14e43917e295ee61142a5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 08:11:36.552211 27404 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758428df9488427c92435892def3d4fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.538304 27483 tablet_service.cc:1467] Processing CreateTablet for tablet 4fb611f9eafc4e109c6d0989d6c409e9 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240501 08:11:36.553942 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 32c2c9a4cc824e1cacc1cf572f08b1a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.553939 27562 tablet_service.cc:1467] Processing CreateTablet for tablet 758428df9488427c92435892def3d4fe (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 08:11:36.554404 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fb611f9eafc4e109c6d0989d6c409e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.554587 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e121a0b28dc14dec962f98efc3f08137. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.554718 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8aff03771b047a991c020cc628aa057. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.555441 27562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758428df9488427c92435892def3d4fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.555471 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18d08b926bac4fc5aac71cf5d27404f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.555181 27613 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.555840 27613 ts_tablet_manager.cc:1367] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.196s user 0.044s sys 0.031s
I20240501 08:11:36.557732 27405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb4b579b3d14e43917e295ee61142a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.559733 27555 tablet_service.cc:1467] Processing CreateTablet for tablet a53c3300b338440eafaf8027a46fb3e3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 08:11:36.561395 27555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53c3300b338440eafaf8027a46fb3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.569144 27613 raft_consensus.cc:348] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.569316 27613 raft_consensus.cc:374] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.569370 27613 raft_consensus.cc:729] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.569571 27613 consensus_queue.cc:260] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.572319 27613 ts_tablet_manager.cc:1398] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20240501 08:11:36.572640 27613 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.576665 27623 tablet_bootstrap.cc:654] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.587060 27612 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.587221 27612 ts_tablet_manager.cc:1367] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.072s user 0.012s sys 0.000s
I20240501 08:11:36.587674 27479 tablet_service.cc:1467] Processing CreateTablet for tablet 739e5b2ab7a64581b57f3e9b0e58e87c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240501 08:11:36.588066 27479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 739e5b2ab7a64581b57f3e9b0e58e87c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.590060 27617 raft_consensus.cc:482] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.590193 27617 raft_consensus.cc:504] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.596321 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:36.596781 27538 leader_election.cc:341] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.597007 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.595798 27617 leader_election.cc:288] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
W20240501 08:11:36.597594 27537 leader_election.cc:341] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.597769 27537 leader_election.cc:302] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:36.598248 27617 raft_consensus.cc:2726] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.598587 27488 tablet_service.cc:1467] Processing CreateTablet for tablet 5d3e2c9d80984b2bacd3b622142ff06f (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240501 08:11:36.598984 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d3e2c9d80984b2bacd3b622142ff06f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.600894 27487 tablet_service.cc:1467] Processing CreateTablet for tablet 6e87b258f8974e47a9ce6295482b0538 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240501 08:11:36.601264 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e87b258f8974e47a9ce6295482b0538. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.606976 27482 tablet_service.cc:1467] Processing CreateTablet for tablet beef83ab3d784309ab81be0edf2cc501 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240501 08:11:36.607421 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beef83ab3d784309ab81be0edf2cc501. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.607388 27486 tablet_service.cc:1467] Processing CreateTablet for tablet bac1e15e326d46caa81b84339ab3b9fa (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240501 08:11:36.607878 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bac1e15e326d46caa81b84339ab3b9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.609439 27481 tablet_service.cc:1467] Processing CreateTablet for tablet ae61fd4c429647b5930c7b71766a94e2 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240501 08:11:36.609782 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae61fd4c429647b5930c7b71766a94e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.614233 27483 tablet_service.cc:1467] Processing CreateTablet for tablet d391d2e046644170902ab1c13b99bc20 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240501 08:11:36.614602 27483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391d2e046644170902ab1c13b99bc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.614934 27484 tablet_service.cc:1467] Processing CreateTablet for tablet cada09f967514de596b2d1e25598729e (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240501 08:11:36.615186 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cada09f967514de596b2d1e25598729e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.617110 27480 tablet_service.cc:1467] Processing CreateTablet for tablet 44c134f2aacd4ec0b28877d654a63634 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240501 08:11:36.617462 27480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c134f2aacd4ec0b28877d654a63634. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.617702 27488 tablet_service.cc:1467] Processing CreateTablet for tablet 1f7cfadebf624d81b6e1f5ded8397a19 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240501 08:11:36.618142 27629 raft_consensus.cc:482] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.618254 27629 raft_consensus.cc:504] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.619016 27629 leader_election.cc:288] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.619841 27488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f7cfadebf624d81b6e1f5ded8397a19. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.628187 27481 tablet_service.cc:1467] Processing CreateTablet for tablet cf58f5006691429cbd87172f4398e9c8 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240501 08:11:36.628744 27481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf58f5006691429cbd87172f4398e9c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20240501 08:11:36.642601 27369 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 08:11:36.643488 27612 raft_consensus.cc:348] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.644449 27612 raft_consensus.cc:374] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.644532 27612 raft_consensus.cc:729] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.644795 27612 consensus_queue.cc:260] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.647257 27612 ts_tablet_manager.cc:1398] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.060s user 0.002s sys 0.000s
I20240501 08:11:36.649544 27613 tablet_bootstrap.cc:654] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.650364 27487 tablet_service.cc:1467] Processing CreateTablet for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240501 08:11:36.650938 27487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c25f8ef6a0c48d39d96ae18625b7c1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.653373 27612 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.657558 27485 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb4b579b3d14e43917e295ee61142a5 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240501 08:11:36.658124 27485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb4b579b3d14e43917e295ee61142a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.665273 27623 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.665457 27623 ts_tablet_manager.cc:1367] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.117s user 0.007s sys 0.011s
I20240501 08:11:36.676914 27629 raft_consensus.cc:482] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.677150 27629 raft_consensus.cc:504] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.678082 27629 leader_election.cc:288] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.680457 27484 tablet_service.cc:1467] Processing CreateTablet for tablet fdc5538831434a728aa68ffc27f288e0 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240501 08:11:36.681819 27482 tablet_service.cc:1467] Processing CreateTablet for tablet 758428df9488427c92435892def3d4fe (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240501 08:11:36.682365 27482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 758428df9488427c92435892def3d4fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.683789 27484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc5538831434a728aa68ffc27f288e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.687070 27623 raft_consensus.cc:348] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.687240 27623 raft_consensus.cc:374] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.687275 27623 raft_consensus.cc:729] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.687558 27623 consensus_queue.cc:260] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.689725 27623 ts_tablet_manager.cc:1398] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.024s user 0.000s sys 0.003s
I20240501 08:11:36.690043 27623 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.691238 27486 tablet_service.cc:1467] Processing CreateTablet for tablet a53c3300b338440eafaf8027a46fb3e3 (DEFAULT_TABLE table=test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240501 08:11:36.692708 27486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a53c3300b338440eafaf8027a46fb3e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:36.711423 27612 tablet_bootstrap.cc:654] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.716380 27623 tablet_bootstrap.cc:654] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.718804 27613 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.719142 27613 ts_tablet_manager.cc:1367] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.147s user 0.007s sys 0.010s
I20240501 08:11:36.725857 27623 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.726014 27623 ts_tablet_manager.cc:1367] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.036s user 0.000s sys 0.007s
I20240501 08:11:36.726955 27623 raft_consensus.cc:348] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.727169 27623 raft_consensus.cc:374] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.727052 27613 raft_consensus.cc:348] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.727241 27623 raft_consensus.cc:729] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.727264 27613 raft_consensus.cc:374] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.727346 27613 raft_consensus.cc:729] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.727507 27612 tablet_bootstrap.cc:492] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.727465 27623 consensus_queue.cc:260] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.727617 27612 ts_tablet_manager.cc:1367] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.074s user 0.007s sys 0.006s
I20240501 08:11:36.727566 27613 consensus_queue.cc:260] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.728883 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.729076 27572 raft_consensus.cc:2454] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:36.729317 27613 ts_tablet_manager.cc:1398] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20240501 08:11:36.729350 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.729591 27613 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.730175 27462 leader_election.cc:302] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
W20240501 08:11:36.730474 27462 leader_election.cc:341] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.730770 27629 raft_consensus.cc:2781] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.730849 27629 raft_consensus.cc:482] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.730921 27629 raft_consensus.cc:3037] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.731323 27613 tablet_bootstrap.cc:654] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.732065 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.732467 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.732712 27422 raft_consensus.cc:2454] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:36.728042 27623 ts_tablet_manager.cc:1398] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:36.733316 27623 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.733666 27629 raft_consensus.cc:504] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:36.733948 27463 leader_election.cc:341] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.734275 27629 leader_election.cc:288] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.734364 27463 leader_election.cc:302] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters: ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:36.734937 27623 tablet_bootstrap.cc:654] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.736392 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
W20240501 08:11:36.738766 27463 leader_election.cc:341] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.739591 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:36.739756 27571 raft_consensus.cc:3037] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.740355 27613 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.740451 27623 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.740525 27613 ts_tablet_manager.cc:1367] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.010s
I20240501 08:11:36.728307 27612 raft_consensus.cc:348] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.740571 27623 ts_tablet_manager.cc:1367] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20240501 08:11:36.740612 27612 raft_consensus.cc:374] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.740695 27612 raft_consensus.cc:729] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.740936 27612 consensus_queue.cc:260] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.741284 27623 raft_consensus.cc:348] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.741446 27623 raft_consensus.cc:374] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.741497 27623 raft_consensus.cc:729] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.741521 27612 ts_tablet_manager.cc:1398] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20240501 08:11:36.741777 27612 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.741731 27623 consensus_queue.cc:260] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.741886 27613 raft_consensus.cc:348] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.742033 27613 raft_consensus.cc:374] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.742102 27613 raft_consensus.cc:729] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.742305 27613 consensus_queue.cc:260] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.742939 27571 raft_consensus.cc:2454] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:36.743448 27612 tablet_bootstrap.cc:654] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.745278 27613 ts_tablet_manager.cc:1398] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240501 08:11:36.745342 27462 leader_election.cc:302] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93
I20240501 08:11:36.746224 27629 raft_consensus.cc:2781] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.746366 27629 raft_consensus.cc:482] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.746495 27629 raft_consensus.cc:3037] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.746961 27644 raft_consensus.cc:2781] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.747076 27644 raft_consensus.cc:686] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:36.747370 27644 consensus_queue.cc:237] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.750039 27629 raft_consensus.cc:504] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.751191 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:36.751422 27422 raft_consensus.cc:3037] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.753096 27613 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.755173 27422 raft_consensus.cc:2454] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:36.756007 27463 leader_election.cc:302] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:36.756278 27644 raft_consensus.cc:2781] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.755519 27613 tablet_bootstrap.cc:654] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.755553 27617 raft_consensus.cc:482] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.756379 27644 raft_consensus.cc:686] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:36.756556 27617 raft_consensus.cc:504] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.756860 27612 tablet_bootstrap.cc:492] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.756999 27612 ts_tablet_manager.cc:1367] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.011s
I20240501 08:11:36.757225 27617 leader_election.cc:288] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.757629 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.757813 27497 raft_consensus.cc:2454] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.757575 27320 catalog_manager.cc:5484] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:36.758334 27538 leader_election.cc:302] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.758587 27617 raft_consensus.cc:2781] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.758669 27617 raft_consensus.cc:482] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.758755 27617 raft_consensus.cc:3037] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.759517 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
W20240501 08:11:36.760195 27462 leader_election.cc:341] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.761171 27629 leader_election.cc:288] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.762693 27617 raft_consensus.cc:504] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.763595 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:36.763834 27423 raft_consensus.cc:3037] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.766247 27624 raft_consensus.cc:482] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.766377 27624 raft_consensus.cc:504] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.766918 27624 leader_election.cc:288] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.767194 27423 raft_consensus.cc:2454] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.767593 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d85013bac4c29ad870792bd90ee7f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.768332 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.768522 27498 raft_consensus.cc:3037] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.768630 27537 leader_election.cc:302] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.769073 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "198717dcedd844a5a8a9b7b2e7d29b76" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.769261 27422 raft_consensus.cc:2362] T 198717dcedd844a5a8a9b7b2e7d29b76 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1. Re-sending same reply.
I20240501 08:11:36.769506 27623 ts_tablet_manager.cc:1398] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.029s user 0.001s sys 0.022s
I20240501 08:11:36.769922 27623 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.767593 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d85013bac4c29ad870792bd90ee7f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.771425 27497 raft_consensus.cc:2454] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:36.771842 27389 leader_election.cc:302] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:36.772146 27624 raft_consensus.cc:2781] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.772246 27624 raft_consensus.cc:482] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.772300 27623 tablet_bootstrap.cc:654] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.772604 27612 raft_consensus.cc:348] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.772789 27612 raft_consensus.cc:374] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.772862 27612 raft_consensus.cc:729] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.773113 27498 raft_consensus.cc:2454] T 198717dcedd844a5a8a9b7b2e7d29b76 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.772320 27624 raft_consensus.cc:3037] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.773988 27612 consensus_queue.cc:260] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.777117 27624 raft_consensus.cc:504] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.778337 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d85013bac4c29ad870792bd90ee7f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.778559 27497 raft_consensus.cc:3037] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.782598 27650 raft_consensus.cc:2781] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.782574 27497 raft_consensus.cc:2454] T 6f0d85013bac4c29ad870792bd90ee7f P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:36.783077 27389 leader_election.cc:302] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:36.783309 27612 ts_tablet_manager.cc:1398] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.026s user 0.002s sys 0.003s
I20240501 08:11:36.785004 27612 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.786829 27612 tablet_bootstrap.cc:654] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.787137 27624 leader_election.cc:288] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.787555 27624 raft_consensus.cc:2781] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.756760 27644 consensus_queue.cc:237] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.787693 27624 raft_consensus.cc:686] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:36.787904 27624 consensus_queue.cc:237] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.768112 27617 leader_election.cc:288] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.809973 27613 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.810307 27613 ts_tablet_manager.cc:1367] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.057s user 0.018s sys 0.030s
I20240501 08:11:36.811503 27613 raft_consensus.cc:348] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.811935 27613 raft_consensus.cc:374] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.812053 27613 raft_consensus.cc:729] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.811740 27650 raft_consensus.cc:686] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:36.813485 27613 consensus_queue.cc:260] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:36.814095 27537 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.181.129:42561, user_credentials={real_user=slave}} blocked reactor thread for 45447.4us
W20240501 08:11:36.814720 27387 leader_election.cc:341] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.815115 27613 ts_tablet_manager.cc:1398] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:36.815580 27613 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.817895 27321 catalog_manager.cc:5484] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:36.819034 27623 tablet_bootstrap.cc:492] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.819113 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f0d85013bac4c29ad870792bd90ee7f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:36.819237 27623 ts_tablet_manager.cc:1367] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.049s user 0.020s sys 0.028s
I20240501 08:11:36.819332 27571 raft_consensus.cc:3037] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.820120 27613 tablet_bootstrap.cc:654] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.821138 27650 consensus_queue.cc:237] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.822361 27571 raft_consensus.cc:2454] T 6f0d85013bac4c29ad870792bd90ee7f P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:36.823617 27612 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.823771 27612 ts_tablet_manager.cc:1367] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.002s
I20240501 08:11:36.824496 27612 raft_consensus.cc:348] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.824682 27612 raft_consensus.cc:374] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.824759 27612 raft_consensus.cc:729] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.825052 27612 consensus_queue.cc:260] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.825366 27623 raft_consensus.cc:348] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.825569 27623 raft_consensus.cc:374] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.825637 27612 ts_tablet_manager.cc:1398] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:36.825656 27623 raft_consensus.cc:729] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.825938 27612 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.825891 27623 consensus_queue.cc:260] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.826512 27623 ts_tablet_manager.cc:1398] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:36.826292 27319 catalog_manager.cc:5484] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:36.826807 27623 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.827730 27612 tablet_bootstrap.cc:654] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.827986 27650 raft_consensus.cc:482] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.828166 27650 raft_consensus.cc:504] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.828397 27623 tablet_bootstrap.cc:654] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.829209 27613 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.829262 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e42523487740e6a1df02db3a644215" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.829363 27613 ts_tablet_manager.cc:1367] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20240501 08:11:36.829475 27422 raft_consensus.cc:2454] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.829887 27613 raft_consensus.cc:348] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.830021 27613 raft_consensus.cc:374] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.830057 27613 raft_consensus.cc:729] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.830178 27613 consensus_queue.cc:260] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.830520 27613 ts_tablet_manager.cc:1398] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:36.830536 27537 leader_election.cc:302] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.830987 27648 raft_consensus.cc:2781] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.831137 27648 raft_consensus.cc:482] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.831310 27648 raft_consensus.cc:3037] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.830694 27613 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.833384 27613 tablet_bootstrap.cc:654] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.834465 27650 leader_election.cc:288] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.834543 27648 raft_consensus.cc:504] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.835040 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e42523487740e6a1df02db3a644215" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.835330 27497 raft_consensus.cc:2454] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.835633 27648 leader_election.cc:288] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.836194 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e42523487740e6a1df02db3a644215" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:36.836422 27422 raft_consensus.cc:3037] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.837100 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9e42523487740e6a1df02db3a644215" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.837311 27497 raft_consensus.cc:3037] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.840170 27422 raft_consensus.cc:2454] T f9e42523487740e6a1df02db3a644215 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.839859 27320 catalog_manager.cc:5484] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:36.840953 27537 leader_election.cc:302] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.841293 27650 raft_consensus.cc:2781] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.841441 27650 raft_consensus.cc:686] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:36.841691 27650 consensus_queue.cc:237] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.842389 27612 tablet_bootstrap.cc:492] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.842551 27612 ts_tablet_manager.cc:1367] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.003s
I20240501 08:11:36.843339 27612 raft_consensus.cc:348] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.843547 27612 raft_consensus.cc:374] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.843624 27612 raft_consensus.cc:729] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.843684 27497 raft_consensus.cc:2454] T f9e42523487740e6a1df02db3a644215 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.843843 27612 consensus_queue.cc:260] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.844391 27612 ts_tablet_manager.cc:1398] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:36.844671 27612 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.846644 27612 tablet_bootstrap.cc:654] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.848363 27623 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.848524 27623 ts_tablet_manager.cc:1367] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20240501 08:11:36.848969 27321 catalog_manager.cc:5484] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:36.849417 27623 raft_consensus.cc:348] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.849629 27623 raft_consensus.cc:374] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.849687 27623 raft_consensus.cc:729] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.849792 27613 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.849921 27613 ts_tablet_manager.cc:1367] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.006s
I20240501 08:11:36.849896 27623 consensus_queue.cc:260] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.850457 27623 ts_tablet_manager.cc:1398] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:36.850751 27623 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.850643 27613 raft_consensus.cc:348] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.850822 27613 raft_consensus.cc:374] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.850901 27613 raft_consensus.cc:729] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.851150 27613 consensus_queue.cc:260] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.852679 27623 tablet_bootstrap.cc:654] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.853086 27613 ts_tablet_manager.cc:1398] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:36.853359 27613 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.855063 27613 tablet_bootstrap.cc:654] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.856392 27612 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.856565 27612 ts_tablet_manager.cc:1367] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.003s
I20240501 08:11:36.857631 27650 raft_consensus.cc:482] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.857609 27612 raft_consensus.cc:348] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.857913 27612 raft_consensus.cc:374] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.857817 27650 raft_consensus.cc:504] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.857978 27612 raft_consensus.cc:729] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.858181 27612 consensus_queue.cc:260] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.858572 27650 leader_election.cc:288] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.858628 27612 ts_tablet_manager.cc:1398] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:36.859148 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.859411 27497 raft_consensus.cc:2454] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.859388 27612 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.859776 27538 leader_election.cc:302] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.860061 27650 raft_consensus.cc:2781] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.860106 27623 tablet_bootstrap.cc:492] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.860162 27650 raft_consensus.cc:482] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.860256 27650 raft_consensus.cc:3037] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.860381 27623 ts_tablet_manager.cc:1367] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20240501 08:11:36.861158 27623 raft_consensus.cc:348] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.861428 27623 raft_consensus.cc:374] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.861584 27612 tablet_bootstrap.cc:654] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.861554 27623 raft_consensus.cc:729] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.859124 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.862003 27422 raft_consensus.cc:2454] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.861976 27623 consensus_queue.cc:260] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.862673 27623 ts_tablet_manager.cc:1398] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:36.863222 27650 raft_consensus.cc:504] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.864288 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:36.864497 27623 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.864569 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a04b931cea214794ae4ffef7b08f5988" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.864720 27497 raft_consensus.cc:3037] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.866595 27422 raft_consensus.cc:3037] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.867122 27623 tablet_bootstrap.cc:654] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.867766 27497 raft_consensus.cc:2454] T a04b931cea214794ae4ffef7b08f5988 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.868157 27538 leader_election.cc:302] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.868441 27650 leader_election.cc:288] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.868604 27650 raft_consensus.cc:2781] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.868705 27650 raft_consensus.cc:686] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:36.868937 27650 consensus_queue.cc:237] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.871668 27422 raft_consensus.cc:2454] T a04b931cea214794ae4ffef7b08f5988 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.875068 27613 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.875253 27613 ts_tablet_manager.cc:1367] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.003s
I20240501 08:11:36.876281 27613 raft_consensus.cc:348] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.876602 27613 raft_consensus.cc:374] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.876677 27613 raft_consensus.cc:729] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.876967 27613 consensus_queue.cc:260] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.880263 27320 catalog_manager.cc:5484] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:36.880633 27613 ts_tablet_manager.cc:1398] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:36.882786 27613 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.884624 27613 tablet_bootstrap.cc:654] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.885531 27623 tablet_bootstrap.cc:492] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.885747 27623 ts_tablet_manager.cc:1367] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.004s
I20240501 08:11:36.886499 27612 tablet_bootstrap.cc:492] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.886476 27623 raft_consensus.cc:348] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.886655 27612 ts_tablet_manager.cc:1367] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.011s
I20240501 08:11:36.886688 27613 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.886699 27623 raft_consensus.cc:374] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.886822 27613 ts_tablet_manager.cc:1367] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:36.886911 27623 raft_consensus.cc:729] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.887109 27623 consensus_queue.cc:260] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.887256 27612 raft_consensus.cc:348] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.887439 27612 raft_consensus.cc:374] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.887498 27612 raft_consensus.cc:729] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.887473 27613 raft_consensus.cc:348] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.887671 27613 raft_consensus.cc:374] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.887743 27613 raft_consensus.cc:729] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.887679 27612 consensus_queue.cc:260] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.887933 27613 consensus_queue.cc:260] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.888263 27612 ts_tablet_manager.cc:1398] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:36.888568 27612 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.890053 27623 ts_tablet_manager.cc:1398] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:36.890383 27613 ts_tablet_manager.cc:1398] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 08:11:36.890834 27612 tablet_bootstrap.cc:654] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.892007 27613 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.892369 27623 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.893146 27652 raft_consensus.cc:482] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.893260 27652 raft_consensus.cc:504] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.893940 27652 leader_election.cc:288] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.894416 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70989ab91fe5428f8eef03dc9ba62cc0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.894575 27497 raft_consensus.cc:2454] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:36.894652 27623 tablet_bootstrap.cc:654] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.894824 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70989ab91fe5428f8eef03dc9ba62cc0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:36.894970 27571 raft_consensus.cc:2454] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:36.895352 27387 leader_election.cc:302] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.895696 27652 raft_consensus.cc:2781] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.895778 27652 raft_consensus.cc:482] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.895854 27652 raft_consensus.cc:3037] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.896899 27613 tablet_bootstrap.cc:654] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.899031 27650 raft_consensus.cc:482] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.899196 27650 raft_consensus.cc:504] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.899196 27652 raft_consensus.cc:504] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.899870 27650 leader_election.cc:288] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.900332 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70989ab91fe5428f8eef03dc9ba62cc0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.900383 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.900487 27498 raft_consensus.cc:3037] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:11:36.900903 27537 leader_election.cc:341] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.904309 27498 raft_consensus.cc:2454] T 70989ab91fe5428f8eef03dc9ba62cc0 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:36.904611 27612 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.904742 27389 leader_election.cc:302] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:36.904805 27612 ts_tablet_manager.cc:1367] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.004s
I20240501 08:11:36.905053 27624 raft_consensus.cc:2781] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.905465 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.905851 27612 raft_consensus.cc:348] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:36.906060 27538 leader_election.cc:341] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.906106 27612 raft_consensus.cc:374] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.906185 27538 leader_election.cc:302] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:36.906713 27650 raft_consensus.cc:2726] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.906183 27612 raft_consensus.cc:729] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.907203 27612 consensus_queue.cc:260] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.908903 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70989ab91fe5428f8eef03dc9ba62cc0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:36.909111 27571 raft_consensus.cc:3037] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.911463 27612 ts_tablet_manager.cc:1398] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:36.914009 27571 raft_consensus.cc:2454] T 70989ab91fe5428f8eef03dc9ba62cc0 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:36.914677 27652 leader_election.cc:288] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.915226 27612 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.915783 27652 raft_consensus.cc:482] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.915931 27652 raft_consensus.cc:504] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.917188 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:36.917754 27389 leader_election.cc:341] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.917902 27612 tablet_bootstrap.cc:654] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.919731 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:36.920286 27387 leader_election.cc:341] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:36.920418 27387 leader_election.cc:302] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:36.920543 27623 tablet_bootstrap.cc:492] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.920675 27623 ts_tablet_manager.cc:1367] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.028s user 0.017s sys 0.011s
I20240501 08:11:36.920706 27675 raft_consensus.cc:2726] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:36.920739 27624 raft_consensus.cc:686] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:36.921063 27624 consensus_queue.cc:237] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.921576 27623 raft_consensus.cc:348] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.921767 27623 raft_consensus.cc:374] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.921828 27613 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.921969 27613 ts_tablet_manager.cc:1367] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.012s
I20240501 08:11:36.921834 27623 raft_consensus.cc:729] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.922453 27652 leader_election.cc:288] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:36.922377 27623 consensus_queue.cc:260] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.922694 27613 raft_consensus.cc:348] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.922868 27613 raft_consensus.cc:374] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.922943 27613 raft_consensus.cc:729] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.923076 27612 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.923193 27612 ts_tablet_manager.cc:1367] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20240501 08:11:36.923120 27613 consensus_queue.cc:260] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.923696 27613 ts_tablet_manager.cc:1398] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:36.923815 27612 raft_consensus.cc:348] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.923972 27612 raft_consensus.cc:374] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.923972 27613 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.924099 27612 raft_consensus.cc:729] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.924333 27612 consensus_queue.cc:260] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.924697 27623 ts_tablet_manager.cc:1398] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:11:36.924911 27612 ts_tablet_manager.cc:1398] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:36.925083 27623 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.925221 27612 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.926988 27612 tablet_bootstrap.cc:654] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.930671 27623 tablet_bootstrap.cc:654] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.933104 27613 tablet_bootstrap.cc:654] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.935184 27612 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.935602 27612 ts_tablet_manager.cc:1367] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.002s
I20240501 08:11:36.935760 27623 tablet_bootstrap.cc:492] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.935945 27623 ts_tablet_manager.cc:1367] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
I20240501 08:11:36.936430 27319 catalog_manager.cc:5484] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:36.936851 27623 raft_consensus.cc:348] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.937063 27623 raft_consensus.cc:374] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.937184 27623 raft_consensus.cc:729] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.937335 27612 raft_consensus.cc:348] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.937816 27612 raft_consensus.cc:374] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.937996 27612 raft_consensus.cc:729] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.938475 27612 consensus_queue.cc:260] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.940577 27612 ts_tablet_manager.cc:1398] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20240501 08:11:36.941150 27612 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.944070 27612 tablet_bootstrap.cc:654] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.944582 27650 raft_consensus.cc:482] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.944782 27650 raft_consensus.cc:504] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.945521 27650 leader_election.cc:288] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.937470 27623 consensus_queue.cc:260] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.945917 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0c3bc1b2a504bc587e2729085b3618b" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.945873 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0c3bc1b2a504bc587e2729085b3618b" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.946130 27498 raft_consensus.cc:2454] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.946174 27422 raft_consensus.cc:2454] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.946434 27623 ts_tablet_manager.cc:1398] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s
I20240501 08:11:36.946704 27613 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.946887 27613 ts_tablet_manager.cc:1367] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.011s
I20240501 08:11:36.946883 27623 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:36.946672 27538 leader_election.cc:302] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.947384 27650 raft_consensus.cc:2781] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.947520 27650 raft_consensus.cc:482] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.947754 27613 raft_consensus.cc:348] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.947993 27613 raft_consensus.cc:374] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.948091 27613 raft_consensus.cc:729] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.948350 27613 consensus_queue.cc:260] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.949002 27613 ts_tablet_manager.cc:1398] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:36.949312 27613 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:36.951347 27613 tablet_bootstrap.cc:654] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.955557 27623 tablet_bootstrap.cc:654] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.959390 27612 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.959563 27612 ts_tablet_manager.cc:1367] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.000s
I20240501 08:11:36.960218 27612 raft_consensus.cc:348] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.960427 27612 raft_consensus.cc:374] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.960479 27612 raft_consensus.cc:729] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.960738 27612 consensus_queue.cc:260] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.961465 27612 ts_tablet_manager.cc:1398] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:36.961831 27612 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:36.963955 27612 tablet_bootstrap.cc:654] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:36.973167 27651 raft_consensus.cc:482] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:36.973407 27651 raft_consensus.cc:504] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.974398 27651 leader_election.cc:288] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.975512 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fe72d61c3422da54771ab3d3b0325" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:36.975800 27422 raft_consensus.cc:2454] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.976361 27537 leader_election.cc:302] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.976683 27651 raft_consensus.cc:2781] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:36.976763 27651 raft_consensus.cc:482] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:36.976851 27651 raft_consensus.cc:3037] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.978058 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fe72d61c3422da54771ab3d3b0325" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:36.978312 27498 raft_consensus.cc:2454] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:36.980656 27651 raft_consensus.cc:504] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.981956 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fe72d61c3422da54771ab3d3b0325" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:36.982192 27422 raft_consensus.cc:3037] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.983914 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c82fe72d61c3422da54771ab3d3b0325" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:36.984094 27498 raft_consensus.cc:3037] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.986073 27422 raft_consensus.cc:2454] T c82fe72d61c3422da54771ab3d3b0325 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.986615 27537 leader_election.cc:302] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:36.987007 27648 raft_consensus.cc:2781] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:36.987143 27648 raft_consensus.cc:686] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:36.987510 27648 consensus_queue.cc:237] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.988183 27498 raft_consensus.cc:2454] T c82fe72d61c3422da54771ab3d3b0325 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:36.988880 27651 leader_election.cc:288] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:36.990293 27623 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:36.991371 27623 ts_tablet_manager.cc:1367] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.011s
I20240501 08:11:36.991127 27650 raft_consensus.cc:3037] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:36.996274 27650 raft_consensus.cc:504] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.998433 27613 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:36.996968 27623 raft_consensus.cc:348] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.998597 27613 ts_tablet_manager.cc:1367] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.049s user 0.016s sys 0.031s
I20240501 08:11:36.998637 27623 raft_consensus.cc:374] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.998744 27612 tablet_bootstrap.cc:492] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:36.998800 27623 raft_consensus.cc:729] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.998883 27612 ts_tablet_manager.cc:1367] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.037s user 0.017s sys 0.019s
I20240501 08:11:36.999166 27623 consensus_queue.cc:260] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.999413 27613 raft_consensus.cc:348] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:36.999569 27613 raft_consensus.cc:374] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:36.999631 27613 raft_consensus.cc:729] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:36.999827 27613 consensus_queue.cc:260] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.000245 27623 ts_tablet_manager.cc:1398] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240501 08:11:37.000339 27613 ts_tablet_manager.cc:1398] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.000617 27623 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.000447 27319 catalog_manager.cc:5484] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:37.000617 27613 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.002247 27613 tablet_bootstrap.cc:654] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.002848 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0c3bc1b2a504bc587e2729085b3618b" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.002379 27623 tablet_bootstrap.cc:654] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.003018 27498 raft_consensus.cc:3037] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.004583 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0c3bc1b2a504bc587e2729085b3618b" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.004760 27422 raft_consensus.cc:3037] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.006325 27498 raft_consensus.cc:2454] T b0c3bc1b2a504bc587e2729085b3618b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.006755 27538 leader_election.cc:302] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.007014 27650 leader_election.cc:288] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.007548 27422 raft_consensus.cc:2454] T b0c3bc1b2a504bc587e2729085b3618b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.007690 27612 raft_consensus.cc:348] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.007920 27612 raft_consensus.cc:374] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.007990 27612 raft_consensus.cc:729] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.008193 27650 raft_consensus.cc:2781] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.008186 27612 consensus_queue.cc:260] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.008584 27650 raft_consensus.cc:686] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.008715 27612 ts_tablet_manager.cc:1398] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20240501 08:11:37.009047 27612 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.008978 27650 consensus_queue.cc:237] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.009773 27623 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.009909 27623 ts_tablet_manager.cc:1367] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.001s
I20240501 08:11:37.010552 27612 tablet_bootstrap.cc:654] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.010540 27623 raft_consensus.cc:348] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.010730 27623 raft_consensus.cc:374] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.010802 27623 raft_consensus.cc:729] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.011612 27623 consensus_queue.cc:260] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.012025 27613 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.012151 27613 ts_tablet_manager.cc:1367] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.003s
I20240501 08:11:37.012229 27623 ts_tablet_manager.cc:1398] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:37.012549 27623 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.012845 27613 raft_consensus.cc:348] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.013034 27613 raft_consensus.cc:374] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.013087 27613 raft_consensus.cc:729] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.013252 27613 consensus_queue.cc:260] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.013782 27613 ts_tablet_manager.cc:1398] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.013654 27320 catalog_manager.cc:5484] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:37.014043 27613 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.014077 27623 tablet_bootstrap.cc:654] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.016273 27613 tablet_bootstrap.cc:654] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.024878 27623 tablet_bootstrap.cc:492] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.024878 27612 tablet_bootstrap.cc:492] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.025090 27623 ts_tablet_manager.cc:1367] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20240501 08:11:37.025102 27613 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.025090 27612 ts_tablet_manager.cc:1367] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.006s
I20240501 08:11:37.025342 27613 ts_tablet_manager.cc:1367] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20240501 08:11:37.025930 27623 raft_consensus.cc:348] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.025930 27612 raft_consensus.cc:348] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.026175 27623 raft_consensus.cc:374] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.026183 27612 raft_consensus.cc:374] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.025959 27613 raft_consensus.cc:348] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.026253 27612 raft_consensus.cc:729] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.026253 27623 raft_consensus.cc:729] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.026281 27613 raft_consensus.cc:374] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.026397 27613 raft_consensus.cc:729] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.026520 27612 consensus_queue.cc:260] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.026520 27623 consensus_queue.cc:260] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.026624 27613 consensus_queue.cc:260] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.027087 27613 ts_tablet_manager.cc:1398] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 08:11:37.027065 27612 ts_tablet_manager.cc:1398] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 08:11:37.027439 27612 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.028050 27613 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.028928 27612 tablet_bootstrap.cc:654] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.029464 27613 tablet_bootstrap.cc:654] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.033082 27613 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.033218 27613 ts_tablet_manager.cc:1367] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20240501 08:11:37.033852 27613 raft_consensus.cc:348] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.034006 27613 raft_consensus.cc:374] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.034063 27613 raft_consensus.cc:729] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.034281 27613 consensus_queue.cc:260] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.034698 27623 ts_tablet_manager.cc:1398] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 08:11:37.034864 27613 ts_tablet_manager.cc:1398] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.035185 27613 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.036659 27613 tablet_bootstrap.cc:654] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.038154 27613 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.038286 27613 ts_tablet_manager.cc:1367] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:37.038913 27613 raft_consensus.cc:348] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.039112 27613 raft_consensus.cc:374] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.039176 27613 raft_consensus.cc:729] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.039410 27613 consensus_queue.cc:260] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.039878 27613 ts_tablet_manager.cc:1398] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:37.040102 27613 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.041301 27613 tablet_bootstrap.cc:654] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.041785 27623 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.044338 27613 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.044472 27613 ts_tablet_manager.cc:1367] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:37.045069 27613 raft_consensus.cc:348] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.045226 27613 raft_consensus.cc:374] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.045285 27613 raft_consensus.cc:729] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.045516 27613 consensus_queue.cc:260] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.045825 27623 tablet_bootstrap.cc:654] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.046120 27613 ts_tablet_manager.cc:1398] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.046375 27613 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.047742 27613 tablet_bootstrap.cc:654] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.050706 27612 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.051005 27612 ts_tablet_manager.cc:1367] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.011s
I20240501 08:11:37.051360 27650 raft_consensus.cc:482] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.051517 27650 raft_consensus.cc:504] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.051981 27623 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.052111 27623 ts_tablet_manager.cc:1367] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20240501 08:11:37.052244 27650 leader_election.cc:288] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.052759 27623 raft_consensus.cc:348] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.052773 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d93678464084b9884fd9eb4c2659ff6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.052984 27623 raft_consensus.cc:374] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.053081 27623 raft_consensus.cc:729] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.053097 27422 raft_consensus.cc:2454] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.053256 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d93678464084b9884fd9eb4c2659ff6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.053301 27623 consensus_queue.cc:260] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.053413 27498 raft_consensus.cc:2454] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.052773 27612 raft_consensus.cc:348] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.053812 27537 leader_election.cc:302] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.053853 27612 raft_consensus.cc:374] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.054046 27612 raft_consensus.cc:729] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.054440 27676 raft_consensus.cc:482] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.054404 27612 consensus_queue.cc:260] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.054761 27650 raft_consensus.cc:2781] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.054850 27650 raft_consensus.cc:482] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.054919 27650 raft_consensus.cc:3037] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.055301 27623 ts_tablet_manager.cc:1398] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:37.055480 27612 ts_tablet_manager.cc:1398] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240501 08:11:37.055575 27623 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.057268 27623 tablet_bootstrap.cc:654] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.057663 27650 raft_consensus.cc:504] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.054572 27676 raft_consensus.cc:504] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.058913 27676 leader_election.cc:288] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.059273 27613 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.059219 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.059415 27613 ts_tablet_manager.cc:1367] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.005s
I20240501 08:11:37.059552 27648 raft_consensus.cc:482] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.059621 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.059799 27571 raft_consensus.cc:2379] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 221d03143b8c485bb23ea0460fd63c93 in current term 1: Already voted for candidate 8547734889f841dbbbff809909a0fc3b in this term.
I20240501 08:11:37.059679 27648 raft_consensus.cc:504] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.060199 27650 leader_election.cc:288] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.060362 27648 leader_election.cc:288] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:37.060179 27613 raft_consensus.cc:348] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.058173 27612 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.060459 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d93678464084b9884fd9eb4c2659ff6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.060588 27498 raft_consensus.cc:3037] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.062024 27612 tablet_bootstrap.cc:654] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.063474 27613 raft_consensus.cc:374] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.063558 27613 raft_consensus.cc:729] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.063637 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d93678464084b9884fd9eb4c2659ff6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.063740 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.063812 27422 raft_consensus.cc:3037] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.063756 27613 consensus_queue.cc:260] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.063928 27423 raft_consensus.cc:2379] T 8a8b420b6cc6452480f80e1647a96684 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3c290047e7442da83cf10d6c197e05 in current term 1: Already voted for candidate 8547734889f841dbbbff809909a0fc3b in this term.
I20240501 08:11:37.064275 27613 ts_tablet_manager.cc:1398] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20240501 08:11:37.064523 27613 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.064981 27387 leader_election.cc:302] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.065184 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a8b420b6cc6452480f80e1647a96684" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.065351 27676 raft_consensus.cc:3037] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.066114 27613 tablet_bootstrap.cc:654] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.066232 27498 raft_consensus.cc:2454] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.066452 27422 raft_consensus.cc:2454] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.066700 27538 leader_election.cc:302] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.066995 27648 raft_consensus.cc:2781] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.067157 27648 raft_consensus.cc:686] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.067438 27648 consensus_queue.cc:237] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.067931 27676 raft_consensus.cc:2726] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.068748 27537 leader_election.cc:302] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.071585 27650 raft_consensus.cc:3037] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.074317 27644 raft_consensus.cc:482] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.074512 27644 raft_consensus.cc:504] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.075428 27644 leader_election.cc:288] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.076395 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.076700 27571 raft_consensus.cc:2454] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.077378 27462 leader_election.cc:302] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.077730 27644 raft_consensus.cc:2781] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.077883 27644 raft_consensus.cc:482] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.078006 27644 raft_consensus.cc:3037] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.079658 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.079932 27422 raft_consensus.cc:2454] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.083226 27644 raft_consensus.cc:504] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.085165 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.085466 27422 raft_consensus.cc:3037] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.089504 27422 raft_consensus.cc:2454] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.090165 27463 leader_election.cc:302] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.090576 27642 raft_consensus.cc:2781] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.090767 27642 raft_consensus.cc:686] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:37.091171 27642 consensus_queue.cc:237] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.095587 27320 catalog_manager.cc:5484] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.100808 27676 raft_consensus.cc:482] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.101053 27676 raft_consensus.cc:504] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.102355 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.102969 27389 leader_election.cc:341] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.103541 27676 leader_election.cc:288] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.104039 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.104319 27571 raft_consensus.cc:2454] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.104771 27387 leader_election.cc:302] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.105479 27676 raft_consensus.cc:2781] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.105610 27676 raft_consensus.cc:482] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.105765 27676 raft_consensus.cc:3037] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.110154 27676 raft_consensus.cc:504] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.111512 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.112191 27389 leader_election.cc:341] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.112916 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.113229 27571 raft_consensus.cc:3037] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.117122 27571 raft_consensus.cc:2454] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.117799 27387 leader_election.cc:302] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.118175 27624 raft_consensus.cc:2781] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.118309 27624 raft_consensus.cc:686] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.118639 27624 consensus_queue.cc:237] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.118836 27644 leader_election.cc:288] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.119105 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a5bbccb6bb04e94bd6d3c7a48ef810e" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.119307 27571 raft_consensus.cc:3037] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.122484 27571 raft_consensus.cc:2454] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.124779 27320 catalog_manager.cc:5484] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.131186 27650 raft_consensus.cc:2726] T 8a8b420b6cc6452480f80e1647a96684 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.132037 27676 leader_election.cc:288] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.132586 27623 tablet_bootstrap.cc:492] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.132786 27623 ts_tablet_manager.cc:1367] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.002s
I20240501 08:11:37.133368 27612 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.133579 27612 ts_tablet_manager.cc:1367] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.075s user 0.036s sys 0.028s
I20240501 08:11:37.133874 27613 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.133806 27623 raft_consensus.cc:348] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.134022 27613 ts_tablet_manager.cc:1367] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.070s user 0.030s sys 0.031s
I20240501 08:11:37.134064 27623 raft_consensus.cc:374] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.134167 27623 raft_consensus.cc:729] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.134418 27623 consensus_queue.cc:260] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.134538 27612 raft_consensus.cc:348] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.134646 27613 raft_consensus.cc:348] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.134764 27612 raft_consensus.cc:374] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.134817 27613 raft_consensus.cc:374] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.134874 27612 raft_consensus.cc:729] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.134932 27623 ts_tablet_manager.cc:1398] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.134932 27613 raft_consensus.cc:729] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.135044 27676 raft_consensus.cc:482] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.135138 27612 consensus_queue.cc:260] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.135221 27676 raft_consensus.cc:504] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.135267 27613 consensus_queue.cc:260] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.135792 27612 ts_tablet_manager.cc:1398] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.135843 27613 ts_tablet_manager.cc:1398] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:37.136099 27613 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.136101 27612 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.136301 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.136495 27498 raft_consensus.cc:2454] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.136955 27389 leader_election.cc:302] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.137286 27624 raft_consensus.cc:2781] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.138296 27624 raft_consensus.cc:482] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.138597 27624 raft_consensus.cc:3037] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.138608 27623 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.140321 27676 leader_election.cc:288] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.140826 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.141153 27644 raft_consensus.cc:482] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.141283 27644 raft_consensus.cc:504] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.142192 27644 leader_election.cc:288] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.142362 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55af818a67e6497ebfb9d17139081e95" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.142750 27612 tablet_bootstrap.cc:654] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.142746 27571 raft_consensus.cc:2454] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.143077 27572 raft_consensus.cc:2454] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.143596 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55af818a67e6497ebfb9d17139081e95" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.143858 27462 leader_election.cc:302] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.143827 27624 raft_consensus.cc:504] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.144327 27623 tablet_bootstrap.cc:654] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.143878 27321 catalog_manager.cc:5484] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:37.145198 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.145457 27644 raft_consensus.cc:2781] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.146339 27624 leader_election.cc:288] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.146533 27422 raft_consensus.cc:2454] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.146553 27676 raft_consensus.cc:482] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.146768 27613 tablet_bootstrap.cc:654] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.146819 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86aa978719c344bca120402ae173afdc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.146998 27498 raft_consensus.cc:3037] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.146912 27676 raft_consensus.cc:504] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.148262 27644 raft_consensus.cc:482] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.148315 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.148396 27644 raft_consensus.cc:3037] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.148516 27497 raft_consensus.cc:2454] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.149350 27572 raft_consensus.cc:3037] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.151152 27644 raft_consensus.cc:504] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.151263 27498 raft_consensus.cc:2454] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.151953 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.152050 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55af818a67e6497ebfb9d17139081e95" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.152192 27571 raft_consensus.cc:2454] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.152263 27422 raft_consensus.cc:3037] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.152819 27389 leader_election.cc:302] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.153272 27623 tablet_bootstrap.cc:492] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.153226 27389 leader_election.cc:302] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.153483 27623 ts_tablet_manager.cc:1367] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20240501 08:11:37.153695 27652 raft_consensus.cc:2781] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.153856 27652 raft_consensus.cc:482] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.153983 27652 raft_consensus.cc:3037] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.154515 27623 raft_consensus.cc:348] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.154804 27623 raft_consensus.cc:374] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.154837 27422 raft_consensus.cc:2454] T 55af818a67e6497ebfb9d17139081e95 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.155019 27623 raft_consensus.cc:729] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.155251 27463 leader_election.cc:302] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.155323 27623 consensus_queue.cc:260] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.155612 27642 raft_consensus.cc:2781] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.156123 27623 ts_tablet_manager.cc:1398] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:37.157083 27613 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.157310 27613 ts_tablet_manager.cc:1367] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.003s
I20240501 08:11:37.157900 27652 raft_consensus.cc:504] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.158223 27613 raft_consensus.cc:348] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.158418 27642 raft_consensus.cc:686] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:37.158562 27613 raft_consensus.cc:374] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.158728 27613 raft_consensus.cc:729] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.158816 27642 consensus_queue.cc:237] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.159132 27613 consensus_queue.cc:260] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.159253 27644 leader_election.cc:288] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.152010 27572 raft_consensus.cc:2454] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.159510 27675 raft_consensus.cc:2781] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.159873 27613 ts_tablet_manager.cc:1398] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.160352 27676 leader_election.cc:288] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.160454 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55af818a67e6497ebfb9d17139081e95" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.160642 27572 raft_consensus.cc:3037] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.161055 27613 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.163125 27613 tablet_bootstrap.cc:654] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.164268 27652 leader_election.cc:288] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.164505 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.164922 27571 raft_consensus.cc:3037] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.164955 27675 raft_consensus.cc:686] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.165195 27675 consensus_queue.cc:237] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.166960 27612 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.167102 27612 ts_tablet_manager.cc:1367] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.004s
I20240501 08:11:37.167704 27612 raft_consensus.cc:348] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.167869 27612 raft_consensus.cc:374] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.167929 27612 raft_consensus.cc:729] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.168125 27612 consensus_queue.cc:260] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.168619 27612 ts_tablet_manager.cc:1398] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:37.168658 27571 raft_consensus.cc:2454] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.169227 27387 leader_election.cc:302] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.169610 27709 raft_consensus.cc:2781] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.169893 27709 raft_consensus.cc:686] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.170276 27709 consensus_queue.cc:237] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.171111 27572 raft_consensus.cc:2454] T 55af818a67e6497ebfb9d17139081e95 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.174108 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d545eb1aba64bdfba55e84f51514fa4" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.174383 27498 raft_consensus.cc:3037] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.176666 27612 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.178189 27498 raft_consensus.cc:2454] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.178978 27612 tablet_bootstrap.cc:654] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.179450 27623 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.184862 27623 tablet_bootstrap.cc:654] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.186743 27321 catalog_manager.cc:5484] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.193164 27321 catalog_manager.cc:5484] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.195829 27623 tablet_bootstrap.cc:492] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.196094 27623 ts_tablet_manager.cc:1367] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20240501 08:11:37.196851 27623 raft_consensus.cc:348] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.197085 27623 raft_consensus.cc:374] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.197171 27623 raft_consensus.cc:729] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.197487 27623 consensus_queue.cc:260] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.199548 27613 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.199765 27613 ts_tablet_manager.cc:1367] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.039s user 0.021s sys 0.016s
I20240501 08:11:37.200068 27612 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.200206 27612 ts_tablet_manager.cc:1367] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.002s
I20240501 08:11:37.200714 27613 raft_consensus.cc:348] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.201026 27613 raft_consensus.cc:374] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.201165 27613 raft_consensus.cc:729] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.201479 27613 consensus_queue.cc:260] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.200803 27612 raft_consensus.cc:348] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.202126 27613 ts_tablet_manager.cc:1398] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:37.202193 27612 raft_consensus.cc:374] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.202358 27612 raft_consensus.cc:729] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.201485 27623 ts_tablet_manager.cc:1398] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:37.202647 27613 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.202602 27612 consensus_queue.cc:260] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.203328 27612 ts_tablet_manager.cc:1398] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:37.203606 27612 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.203503 27321 catalog_manager.cc:5484] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.204792 27613 tablet_bootstrap.cc:654] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.205261 27612 tablet_bootstrap.cc:654] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.207657 27709 raft_consensus.cc:482] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.207930 27709 raft_consensus.cc:504] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.209095 27709 leader_election.cc:288] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.209185 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f924880fbff49f6a9bb7a1397a77963" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.209407 27498 raft_consensus.cc:2454] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.209615 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f924880fbff49f6a9bb7a1397a77963" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.209836 27572 raft_consensus.cc:2454] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.209906 27389 leader_election.cc:302] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.210227 27709 raft_consensus.cc:2781] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.210330 27709 raft_consensus.cc:482] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.210455 27709 raft_consensus.cc:3037] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.211858 27623 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.213428 27709 raft_consensus.cc:504] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.214076 27623 tablet_bootstrap.cc:654] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.214329 27675 raft_consensus.cc:482] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.214423 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f924880fbff49f6a9bb7a1397a77963" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.214493 27675 raft_consensus.cc:504] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.214603 27498 raft_consensus.cc:3037] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.215179 27675 leader_election.cc:288] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.215524 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.215751 27572 raft_consensus.cc:2454] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.216233 27387 leader_election.cc:302] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.216364 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.216606 27675 raft_consensus.cc:2781] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.216730 27675 raft_consensus.cc:482] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.216821 27675 raft_consensus.cc:3037] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:11:37.216840 27389 leader_election.cc:341] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.216953 27613 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.217129 27613 ts_tablet_manager.cc:1367] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20240501 08:11:37.217571 27498 raft_consensus.cc:2454] T 9f924880fbff49f6a9bb7a1397a77963 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.218050 27389 leader_election.cc:302] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.218204 27613 raft_consensus.cc:348] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.218343 27652 raft_consensus.cc:2781] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.218369 27709 leader_election.cc:288] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.218426 27613 raft_consensus.cc:374] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.218524 27652 raft_consensus.cc:686] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.218780 27652 consensus_queue.cc:237] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.219358 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f924880fbff49f6a9bb7a1397a77963" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.219539 27571 raft_consensus.cc:3037] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.219782 27709 consensus_queue.cc:1035] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.220610 27675 raft_consensus.cc:504] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.221488 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.221985 27389 leader_election.cc:341] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.222450 27675 leader_election.cc:288] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.218528 27613 raft_consensus.cc:729] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.222846 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.223034 27570 raft_consensus.cc:3037] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.223604 27612 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.223891 27612 ts_tablet_manager.cc:1367] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.007s
I20240501 08:11:37.224263 27675 raft_consensus.cc:482] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.224512 27675 raft_consensus.cc:504] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.226025 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.226749 27389 leader_election.cc:341] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.223032 27613 consensus_queue.cc:260] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.227440 27570 raft_consensus.cc:2454] T 11ad813120804c88ac5c8f7b08b21c84 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.227754 27613 ts_tablet_manager.cc:1398] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
I20240501 08:11:37.227885 27648 consensus_queue.cc:1035] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.228000 27387 leader_election.cc:302] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.228557 27676 raft_consensus.cc:2781] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.228765 27676 raft_consensus.cc:686] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.229122 27676 consensus_queue.cc:237] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.230636 27675 leader_election.cc:288] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.231200 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.231881 27675 raft_consensus.cc:482] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240501 08:11:37.231995 27387 leader_election.cc:341] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.232189 27387 leader_election.cc:302] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.232167 27675 raft_consensus.cc:504] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.232683 27624 raft_consensus.cc:2726] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.223062 27571 raft_consensus.cc:2454] T 9f924880fbff49f6a9bb7a1397a77963 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.233280 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.233875 27389 leader_election.cc:341] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.234222 27675 leader_election.cc:288] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.235107 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.235399 27571 raft_consensus.cc:2454] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.235896 27387 leader_election.cc:302] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.228091 27613 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.240731 27612 raft_consensus.cc:348] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.241921 27612 raft_consensus.cc:374] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.242238 27612 raft_consensus.cc:729] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.242843 27612 consensus_queue.cc:260] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.241331 27613 tablet_bootstrap.cc:654] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.241075 27675 raft_consensus.cc:2781] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.246487 27675 raft_consensus.cc:482] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.246683 27675 raft_consensus.cc:3037] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.249961 27612 ts_tablet_manager.cc:1398] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20240501 08:11:37.250644 27675 raft_consensus.cc:504] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.253131 27675 leader_election.cc:288] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.253331 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.253567 27570 raft_consensus.cc:3037] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.253525 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.254609 27389 leader_election.cc:341] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.255020 27319 catalog_manager.cc:5484] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.257927 27624 consensus_queue.cc:1035] T 6f0d85013bac4c29ad870792bd90ee7f P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.258334 27570 raft_consensus.cc:2454] T ff6df2ff96c6444bb8b2d8d01065148c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.259119 27623 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.259277 27623 ts_tablet_manager.cc:1367] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.006s
I20240501 08:11:37.259405 27387 leader_election.cc:302] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.260071 27623 raft_consensus.cc:348] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.260262 27623 raft_consensus.cc:374] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.260351 27623 raft_consensus.cc:729] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.260452 27648 consensus_queue.cc:1035] T f9e42523487740e6a1df02db3a644215 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.260604 27623 consensus_queue.cc:260] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.260895 27709 raft_consensus.cc:482] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.261022 27709 raft_consensus.cc:504] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.261274 27623 ts_tablet_manager.cc:1398] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.261559 27623 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.261667 27709 leader_election.cc:288] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.261817 27709 raft_consensus.cc:2781] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.262887 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c323e11ee98466ca9267923970d59a3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.263178 27496 raft_consensus.cc:2454] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.250672 27612 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.263650 27389 leader_election.cc:302] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.263602 27319 catalog_manager.cc:5484] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.264456 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c323e11ee98466ca9267923970d59a3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.264667 27570 raft_consensus.cc:2454] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.265209 27709 raft_consensus.cc:686] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.265261 27675 raft_consensus.cc:2781] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.265385 27675 raft_consensus.cc:482] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.265506 27675 raft_consensus.cc:3037] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.267935 27623 tablet_bootstrap.cc:654] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.268409 27675 raft_consensus.cc:504] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.265511 27709 consensus_queue.cc:237] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.272215 27675 leader_election.cc:288] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.274303 27642 consensus_queue.cc:1035] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.277557 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c323e11ee98466ca9267923970d59a3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.277750 27570 raft_consensus.cc:3037] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.281056 27570 raft_consensus.cc:2454] T 8c323e11ee98466ca9267923970d59a3 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.281548 27387 leader_election.cc:302] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.281904 27675 raft_consensus.cc:2781] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.282049 27675 raft_consensus.cc:686] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.282389 27675 consensus_queue.cc:237] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.288899 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c323e11ee98466ca9267923970d59a3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.289244 27498 raft_consensus.cc:3037] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.290094 27612 tablet_bootstrap.cc:654] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.290225 27613 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.290268 27675 raft_consensus.cc:482] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.292835 27613 ts_tablet_manager.cc:1367] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.063s user 0.007s sys 0.000s
I20240501 08:11:37.294660 27319 catalog_manager.cc:5484] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.295469 27613 raft_consensus.cc:348] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.295760 27613 raft_consensus.cc:374] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.295971 27613 raft_consensus.cc:729] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.296267 27613 consensus_queue.cc:260] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.297214 27613 ts_tablet_manager.cc:1398] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:11:37.297595 27613 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.299965 27675 raft_consensus.cc:504] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.301621 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:37.302407 27387 leader_election.cc:341] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.303164 27675 leader_election.cc:288] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.304061 27613 tablet_bootstrap.cc:654] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.302389 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.308198 27675 raft_consensus.cc:482] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20240501 08:11:37.312234 27389 leader_election.cc:341] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.315433 27389 leader_election.cc:302] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.314810 27675 raft_consensus.cc:504] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.318284 27709 raft_consensus.cc:2726] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.317493 27650 consensus_queue.cc:1035] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240501 08:11:37.319007 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.319106 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.319244 27570 raft_consensus.cc:2454] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.320528 27498 raft_consensus.cc:2454] T 8c323e11ee98466ca9267923970d59a3 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.320957 27642 consensus_queue.cc:1035] T 8a8b420b6cc6452480f80e1647a96684 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20240501 08:11:37.322827 27389 leader_election.cc:341] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.322860 27319 catalog_manager.cc:5484] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.323429 27387 leader_election.cc:302] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.323709 27709 raft_consensus.cc:2781] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.323832 27709 raft_consensus.cc:482] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.323925 27709 raft_consensus.cc:3037] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.326638 27709 raft_consensus.cc:504] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.327003 27675 leader_election.cc:288] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.328727 27709 leader_election.cc:288] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.328822 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.332942 27623 tablet_bootstrap.cc:492] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.333220 27623 ts_tablet_manager.cc:1367] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.072s user 0.024s sys 0.040s
I20240501 08:11:37.334409 27570 raft_consensus.cc:3037] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.334380 27623 raft_consensus.cc:348] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.340498 27623 raft_consensus.cc:374] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.340706 27623 raft_consensus.cc:729] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.341565 27613 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.341625 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.349933 27389 leader_election.cc:341] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.350919 27613 ts_tablet_manager.cc:1367] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.009s
I20240501 08:11:37.350955 27642 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240501 08:11:37.351578 27650 consensus_queue.cc:1035] T 198717dcedd844a5a8a9b7b2e7d29b76 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240501 08:11:37.356997 27642 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.360155 27650 consensus_queue.cc:1035] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.373931 27570 raft_consensus.cc:2454] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.374428 27613 raft_consensus.cc:348] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.376052 27613 raft_consensus.cc:374] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.376186 27613 raft_consensus.cc:729] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.376927 27613 consensus_queue.cc:260] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.377717 27613 ts_tablet_manager.cc:1398] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.027s user 0.000s sys 0.002s
I20240501 08:11:37.378121 27613 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.379357 27650 raft_consensus.cc:482] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.379630 27387 leader_election.cc:302] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.380352 27650 raft_consensus.cc:504] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.380805 27709 raft_consensus.cc:2781] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.381495 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.382015 27675 raft_consensus.cc:482] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.382205 27650 leader_election.cc:288] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.382261 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.354059 27623 consensus_queue.cc:260] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.383235 27496 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.383273 27623 ts_tablet_manager.cc:1398] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.050s user 0.002s sys 0.002s
I20240501 08:11:37.383373 27675 raft_consensus.cc:504] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.384155 27709 raft_consensus.cc:686] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.385301 27613 tablet_bootstrap.cc:654] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.385257 27538 leader_election.cc:302] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.385993 27675 leader_election.cc:288] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.386922 27623 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.386986 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.387171 27496 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.387588 27650 raft_consensus.cc:2781] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.387638 27389 leader_election.cc:302] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.387550 27709 consensus_queue.cc:237] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.387728 27650 raft_consensus.cc:482] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.387846 27650 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.390024 27650 raft_consensus.cc:504] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.390473 27650 leader_election.cc:288] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.386694 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.392403 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.392617 27496 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.392659 27423 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.393349 27675 raft_consensus.cc:2781] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.396004 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.396204 27422 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.397141 27650 consensus_queue.cc:1035] T a04b931cea214794ae4ffef7b08f5988 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.397397 27570 raft_consensus.cc:2379] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 221d03143b8c485bb23ea0460fd63c93 in current term 1: Already voted for candidate ea3c290047e7442da83cf10d6c197e05 in this term.
I20240501 08:11:37.397867 27612 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.398113 27612 ts_tablet_manager.cc:1367] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.148s user 0.023s sys 0.030s
I20240501 08:11:37.399022 27612 raft_consensus.cc:348] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.400933 27612 raft_consensus.cc:374] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.401062 27612 raft_consensus.cc:729] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.401316 27612 consensus_queue.cc:260] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.401984 27612 ts_tablet_manager.cc:1398] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:11:37.402283 27612 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.402941 27422 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.406569 27623 tablet_bootstrap.cc:654] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.407029 27675 raft_consensus.cc:482] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.407024 27319 catalog_manager.cc:5484] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.407800 27613 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.407930 27613 ts_tablet_manager.cc:1367] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.002s
I20240501 08:11:37.410341 27537 leader_election.cc:302] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.410351 27675 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:37.411623 27613 raft_consensus.cc:348] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.411892 27613 raft_consensus.cc:374] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.411958 27613 raft_consensus.cc:729] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.412410 27613 consensus_queue.cc:260] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.413139 27496 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.413240 27675 raft_consensus.cc:504] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.416020 27675 leader_election.cc:288] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 2 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.413805 27613 ts_tablet_manager.cc:1398] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20240501 08:11:37.416527 27613 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.418150 27613 tablet_bootstrap.cc:654] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.419576 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.419855 27496 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:37.420321 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba41d287ba2a41b39b92d0ef8013d7e6" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.423614 27612 tablet_bootstrap.cc:654] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.426923 27496 raft_consensus.cc:2454] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 2.
I20240501 08:11:37.427542 27389 leader_election.cc:302] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters: ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.428176 27709 raft_consensus.cc:2781] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 FOLLOWER]: Leader election won for term 2
I20240501 08:11:37.428330 27709 raft_consensus.cc:686] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.428647 27709 consensus_queue.cc:237] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.432277 27675 consensus_queue.cc:1035] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.453238 27642 raft_consensus.cc:482] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.453464 27642 raft_consensus.cc:504] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.454421 27642 leader_election.cc:288] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.454941 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.455587 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f678d6771a8a4b47bc5d3523bef952e5" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.455894 27571 raft_consensus.cc:2379] T f678d6771a8a4b47bc5d3523bef952e5 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:37.456467 27462 leader_election.cc:302] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.457058 27642 raft_consensus.cc:3037] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.457123 27320 catalog_manager.cc:5484] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 2, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 2 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.457370 27648 raft_consensus.cc:2781] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.457501 27648 raft_consensus.cc:686] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.457837 27648 consensus_queue.cc:237] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.460472 27652 consensus_queue.cc:1035] T 70989ab91fe5428f8eef03dc9ba62cc0 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.484019 27623 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.484179 27613 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.484206 27623 ts_tablet_manager.cc:1367] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.100s user 0.008s sys 0.000s
I20240501 08:11:37.484299 27613 ts_tablet_manager.cc:1367] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.027s
I20240501 08:11:37.485019 27613 raft_consensus.cc:348] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.485247 27613 raft_consensus.cc:374] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.485308 27612 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.485314 27613 raft_consensus.cc:729] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.485613 27613 consensus_queue.cc:260] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.486114 27613 ts_tablet_manager.cc:1398] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.486234 27642 raft_consensus.cc:2726] T f678d6771a8a4b47bc5d3523bef952e5 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.486357 27612 ts_tablet_manager.cc:1367] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.084s user 0.005s sys 0.002s
I20240501 08:11:37.486407 27613 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.486501 27623 raft_consensus.cc:348] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.486676 27623 raft_consensus.cc:374] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.486721 27623 raft_consensus.cc:729] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.486889 27623 consensus_queue.cc:260] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.486985 27612 raft_consensus.cc:348] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.487157 27612 raft_consensus.cc:374] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.487213 27612 raft_consensus.cc:729] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.487394 27623 ts_tablet_manager.cc:1398] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:37.487432 27612 consensus_queue.cc:260] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.487854 27613 tablet_bootstrap.cc:654] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.487920 27612 ts_tablet_manager.cc:1398] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:37.490417 27623 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.491237 27612 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.491912 27623 tablet_bootstrap.cc:654] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.493146 27612 tablet_bootstrap.cc:654] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.493868 27623 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.493867 27675 raft_consensus.cc:482] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.494036 27623 ts_tablet_manager.cc:1367] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:37.494072 27675 raft_consensus.cc:504] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.494686 27675 leader_election.cc:288] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.494596 27623 raft_consensus.cc:348] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.494765 27623 raft_consensus.cc:374] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.494820 27623 raft_consensus.cc:729] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.494995 27623 consensus_queue.cc:260] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.495172 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.495483 27623 ts_tablet_manager.cc:1398] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240501 08:11:37.495747 27623 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
W20240501 08:11:37.496014 27389 leader_election.cc:341] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.494073 27613 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.496397 27613 ts_tablet_manager.cc:1367] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20240501 08:11:37.496171 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.497040 27623 tablet_bootstrap.cc:654] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
W20240501 08:11:37.497002 27387 leader_election.cc:341] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.497129 27387 leader_election.cc:302] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.497354 27613 raft_consensus.cc:348] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.497596 27613 raft_consensus.cc:374] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.497710 27613 raft_consensus.cc:729] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.497957 27613 consensus_queue.cc:260] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.497606 27675 raft_consensus.cc:2726] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.498574 27613 ts_tablet_manager.cc:1398] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:37.498914 27648 consensus_queue.cc:1035] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.499787 27623 tablet_bootstrap.cc:492] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.499902 27623 ts_tablet_manager.cc:1367] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:37.500721 27613 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.500589 27623 raft_consensus.cc:348] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.500855 27623 raft_consensus.cc:374] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.500932 27623 raft_consensus.cc:729] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.501197 27623 consensus_queue.cc:260] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.502069 27613 tablet_bootstrap.cc:654] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.502429 27612 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.502599 27612 ts_tablet_manager.cc:1367] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20240501 08:11:37.503473 27612 raft_consensus.cc:348] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.503794 27612 raft_consensus.cc:374] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.503913 27612 raft_consensus.cc:729] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.504221 27612 consensus_queue.cc:260] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.505056 27612 ts_tablet_manager.cc:1398] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.506664 27623 ts_tablet_manager.cc:1398] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240501 08:11:37.507133 27623 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.509143 27623 tablet_bootstrap.cc:654] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.510277 27651 consensus_queue.cc:1035] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.509850 27612 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.512596 27675 raft_consensus.cc:482] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.512781 27675 raft_consensus.cc:504] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.513350 27612 tablet_bootstrap.cc:654] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.513648 27675 leader_election.cc:288] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.514429 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.514685 27572 raft_consensus.cc:2454] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.515154 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.515252 27387 leader_election.cc:302] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.515522 27675 raft_consensus.cc:2781] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.515606 27675 raft_consensus.cc:482] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240501 08:11:37.515621 27389 leader_election.cc:341] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.515693 27675 raft_consensus.cc:3037] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.516898 27612 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.517060 27612 ts_tablet_manager.cc:1367] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240501 08:11:37.517976 27612 raft_consensus.cc:348] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.518224 27612 raft_consensus.cc:374] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.518276 27612 raft_consensus.cc:729] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.518540 27612 consensus_queue.cc:260] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.519239 27612 ts_tablet_manager.cc:1398] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:37.519608 27612 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.521565 27612 tablet_bootstrap.cc:654] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.522711 27675 raft_consensus.cc:504] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.523499 27613 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.523679 27613 ts_tablet_manager.cc:1367] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.003s
I20240501 08:11:37.523509 27675 leader_election.cc:288] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.523675 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.524488 27389 leader_election.cc:341] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.524799 27613 raft_consensus.cc:348] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.525032 27613 raft_consensus.cc:374] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.525099 27613 raft_consensus.cc:729] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.525357 27613 consensus_queue.cc:260] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.525779 27623 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.525993 27623 ts_tablet_manager.cc:1367] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.000s
I20240501 08:11:37.526760 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.526974 27572 raft_consensus.cc:3037] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.526888 27623 raft_consensus.cc:348] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.527148 27623 raft_consensus.cc:374] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.527256 27623 raft_consensus.cc:729] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.527598 27623 consensus_queue.cc:260] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.528293 27623 ts_tablet_manager.cc:1398] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:37.528712 27623 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.529866 27572 raft_consensus.cc:2454] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.530335 27651 consensus_queue.cc:1035] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.530689 27623 tablet_bootstrap.cc:654] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.530858 27387 leader_election.cc:302] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.531313 27675 raft_consensus.cc:2781] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.531477 27675 raft_consensus.cc:686] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.525995 27613 ts_tablet_manager.cc:1398] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.531754 27675 consensus_queue.cc:237] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.531965 27613 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.533232 27617 raft_consensus.cc:482] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.533385 27617 raft_consensus.cc:504] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.533733 27613 tablet_bootstrap.cc:654] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.533912 27612 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.534080 27617 leader_election.cc:288] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.534559 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.535045 27538 leader_election.cc:341] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.534111 27612 ts_tablet_manager.cc:1367] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.003s
I20240501 08:11:37.535910 27612 raft_consensus.cc:348] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.536185 27612 raft_consensus.cc:374] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.536294 27612 raft_consensus.cc:729] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.536496 27612 consensus_queue.cc:260] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.538980 27652 raft_consensus.cc:482] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.539149 27652 raft_consensus.cc:504] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.540133 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.540315 27652 leader_election.cc:288] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.540349 27420 raft_consensus.cc:2454] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.540947 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.541056 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.541157 27498 raft_consensus.cc:2454] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:37.541330 27642 raft_consensus.cc:482] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.541556 27389 leader_election.cc:302] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.541494 27642 raft_consensus.cc:504] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.542209 27642 leader_election.cc:288] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.542547 27675 raft_consensus.cc:2781] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.542685 27675 raft_consensus.cc:482] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.542799 27675 raft_consensus.cc:3037] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.542877 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
W20240501 08:11:37.543251 27387 leader_election.cc:341] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.543737 27537 leader_election.cc:302] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.544365 27650 raft_consensus.cc:2781] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.544416 27613 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.544505 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.544744 27613 ts_tablet_manager.cc:1367] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.010s
I20240501 08:11:37.544894 27642 raft_consensus.cc:482] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.545038 27642 raft_consensus.cc:504] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.545545 27623 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.545679 27642 leader_election.cc:288] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.545712 27623 ts_tablet_manager.cc:1367] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.006s
I20240501 08:11:37.545845 27613 raft_consensus.cc:348] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.546109 27613 raft_consensus.cc:374] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.544510 27650 raft_consensus.cc:482] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.546291 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b509576adf3c4e2c817f12d3fac6f72b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.546397 27650 raft_consensus.cc:3037] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.546463 27422 raft_consensus.cc:2454] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.546850 27648 consensus_queue.cc:1035] T b0c3bc1b2a504bc587e2729085b3618b P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.547047 27623 raft_consensus.cc:348] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.547250 27623 raft_consensus.cc:374] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.547377 27623 raft_consensus.cc:729] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.544363 27617 consensus_queue.cc:1035] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240501 08:11:37.547577 27463 leader_election.cc:302] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.547610 27623 consensus_queue.cc:260] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.547923 27644 raft_consensus.cc:2781] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.548022 27644 raft_consensus.cc:482] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.548127 27644 raft_consensus.cc:3037] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.548224 27623 ts_tablet_manager.cc:1398] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240501 08:11:37.548523 27623 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.549836 27613 raft_consensus.cc:729] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.550309 27613 consensus_queue.cc:260] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.550801 27644 raft_consensus.cc:504] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.550984 27613 ts_tablet_manager.cc:1398] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240501 08:11:37.549832 27650 raft_consensus.cc:504] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.550937 27319 catalog_manager.cc:5484] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.551259 27613 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.551563 27644 leader_election.cc:288] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.551863 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b509576adf3c4e2c817f12d3fac6f72b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.552062 27422 raft_consensus.cc:3037] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.552420 27709 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.552829 27613 tablet_bootstrap.cc:654] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.553961 27623 tablet_bootstrap.cc:654] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.555264 27675 raft_consensus.cc:504] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:37.555761 27462 leader_election.cc:341] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.556205 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b509576adf3c4e2c817f12d3fac6f72b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.556480 27572 raft_consensus.cc:2454] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.557067 27675 leader_election.cc:288] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.557315 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.557601 27497 raft_consensus.cc:3037] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.558518 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b509576adf3c4e2c817f12d3fac6f72b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.558692 27570 raft_consensus.cc:3037] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.559082 27612 ts_tablet_manager.cc:1398] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20240501 08:11:37.559612 27612 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.560561 27497 raft_consensus.cc:2454] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:37.561429 27570 raft_consensus.cc:2454] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.561847 27420 raft_consensus.cc:2379] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:37.562786 27463 leader_election.cc:302] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.563235 27644 raft_consensus.cc:2726] T a99b775bfcce42cead10cc95ceff2174 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.563911 27389 leader_election.cc:302] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.564244 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:37.564690 27675 raft_consensus.cc:2781] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
W20240501 08:11:37.564801 27387 leader_election.cc:341] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.564854 27675 raft_consensus.cc:686] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:37.565135 27675 consensus_queue.cc:237] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.566411 27422 raft_consensus.cc:2454] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:37.567088 27650 leader_election.cc:288] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.567339 27462 leader_election.cc:302] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.567704 27644 raft_consensus.cc:2781] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.567873 27644 raft_consensus.cc:686] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:37.568231 27644 consensus_queue.cc:237] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.569715 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.569936 27420 raft_consensus.cc:3037] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.571854 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.572369 27538 leader_election.cc:341] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.573884 27420 raft_consensus.cc:2454] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.574276 27537 leader_election.cc:302] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.574875 27650 raft_consensus.cc:2781] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.575806 27650 raft_consensus.cc:686] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.576092 27650 consensus_queue.cc:237] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.580001 27623 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.580001 27613 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.580190 27612 tablet_bootstrap.cc:654] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.580309 27613 ts_tablet_manager.cc:1367] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.015s
I20240501 08:11:37.580333 27623 ts_tablet_manager.cc:1367] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.010s
I20240501 08:11:37.581120 27623 raft_consensus.cc:348] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.581388 27623 raft_consensus.cc:374] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.581475 27623 raft_consensus.cc:729] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.581733 27623 consensus_queue.cc:260] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.582406 27623 ts_tablet_manager.cc:1398] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:37.582746 27623 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.583405 27652 raft_consensus.cc:482] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.583592 27652 raft_consensus.cc:504] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.584260 27651 consensus_queue.cc:1035] T c82fe72d61c3422da54771ab3d3b0325 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.584424 27623 tablet_bootstrap.cc:654] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.584261 27652 leader_election.cc:288] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.585287 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.586114 27613 raft_consensus.cc:348] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.586194 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.586344 27613 raft_consensus.cc:374] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.586452 27613 raft_consensus.cc:729] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.587052 27613 consensus_queue.cc:260] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:37.587445 27387 leader_election.cc:341] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.587815 27613 ts_tablet_manager.cc:1398] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240501 08:11:37.588214 27613 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.588918 27319 catalog_manager.cc:5484] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.590168 27613 tablet_bootstrap.cc:654] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.590340 27675 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.591689 27321 catalog_manager.cc:5484] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
W20240501 08:11:37.594300 27389 leader_election.cc:341] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.594518 27389 leader_election.cc:302] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.595026 27676 raft_consensus.cc:2726] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.597715 27623 tablet_bootstrap.cc:492] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.597957 27623 ts_tablet_manager.cc:1367] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.006s
I20240501 08:11:37.598062 27320 catalog_manager.cc:5484] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:37.598999 27623 raft_consensus.cc:348] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.599339 27623 raft_consensus.cc:374] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.599439 27612 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.599553 27623 raft_consensus.cc:729] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.599651 27612 ts_tablet_manager.cc:1367] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.002s
I20240501 08:11:37.599943 27623 consensus_queue.cc:260] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.600301 27612 raft_consensus.cc:348] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.600536 27612 raft_consensus.cc:374] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.600634 27612 raft_consensus.cc:729] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.600970 27623 ts_tablet_manager.cc:1398] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:37.601032 27612 consensus_queue.cc:260] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.601388 27623 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.601660 27612 ts_tablet_manager.cc:1398] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:37.601979 27612 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.602972 27644 raft_consensus.cc:482] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.603302 27612 tablet_bootstrap.cc:654] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.603145 27644 raft_consensus.cc:504] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.603847 27644 leader_election.cc:288] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.604426 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.603044 27623 tablet_bootstrap.cc:654] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.606606 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6615e3386cc24130a48c758a6e3064dd" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.606915 27570 raft_consensus.cc:2379] T 6615e3386cc24130a48c758a6e3064dd P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:37.606834 27676 consensus_queue.cc:1035] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.607944 27462 leader_election.cc:302] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.608121 27613 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.608343 27613 ts_tablet_manager.cc:1367] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.006s
I20240501 08:11:37.608541 27644 raft_consensus.cc:3037] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.609202 27613 raft_consensus.cc:348] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.609403 27613 raft_consensus.cc:374] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.609555 27613 raft_consensus.cc:729] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.609856 27613 consensus_queue.cc:260] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.609966 27642 consensus_queue.cc:1035] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.613440 27613 ts_tablet_manager.cc:1398] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 08:11:37.614316 27613 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.616477 27613 tablet_bootstrap.cc:654] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.619426 27623 tablet_bootstrap.cc:492] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:37.619668 27623 ts_tablet_manager.cc:1367] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.004s
I20240501 08:11:37.620481 27623 raft_consensus.cc:348] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.620759 27623 raft_consensus.cc:374] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.622210 27644 raft_consensus.cc:2726] T 6615e3386cc24130a48c758a6e3064dd P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.620867 27623 raft_consensus.cc:729] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.622872 27623 consensus_queue.cc:260] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.623098 27612 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:37.623255 27612 ts_tablet_manager.cc:1367] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.011s
I20240501 08:11:37.623481 27623 ts_tablet_manager.cc:1398] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:37.624579 27613 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:37.624760 27613 ts_tablet_manager.cc:1367] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20240501 08:11:37.625504 27623 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:37.625795 27612 raft_consensus.cc:348] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.626013 27612 raft_consensus.cc:374] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.626119 27612 raft_consensus.cc:729] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.626348 27612 consensus_queue.cc:260] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.626917 27612 ts_tablet_manager.cc:1398] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240501 08:11:37.627203 27612 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:37.627506 27623 tablet_bootstrap.cc:654] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.628250 27709 consensus_queue.cc:1035] T f678d6771a8a4b47bc5d3523bef952e5 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.628789 27612 tablet_bootstrap.cc:654] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.629611 27629 consensus_queue.cc:1035] T 0a5bbccb6bb04e94bd6d3c7a48ef810e P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.630004 27613 raft_consensus.cc:348] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.630297 27613 raft_consensus.cc:374] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:37.630398 27613 raft_consensus.cc:729] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:37.630726 27613 consensus_queue.cc:260] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.631466 27613 ts_tablet_manager.cc:1398] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240501 08:11:37.632071 27613 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:37.632122 27709 consensus_queue.cc:1035] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.634017 27613 tablet_bootstrap.cc:654] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:37.642787 27650 raft_consensus.cc:482] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.643054 27650 raft_consensus.cc:504] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.644027 27650 leader_election.cc:288] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.645423 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.645740 27420 raft_consensus.cc:2454] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.646277 27537 leader_election.cc:302] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.646613 27650 raft_consensus.cc:2781] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.646745 27650 raft_consensus.cc:482] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.646857 27650 raft_consensus.cc:3037] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.647229 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.647816 27538 leader_election.cc:341] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.649863 27650 raft_consensus.cc:504] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.650525 27650 leader_election.cc:288] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.651142 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.651381 27420 raft_consensus.cc:3037] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.654064 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.654139 27420 raft_consensus.cc:2454] T 2342377b202a4bfa97e58ee217f56bcc P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.654547 27537 leader_election.cc:302] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
W20240501 08:11:37.654816 27538 leader_election.cc:341] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.655210 27650 raft_consensus.cc:2781] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.655469 27650 raft_consensus.cc:686] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.655799 27650 consensus_queue.cc:237] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.655923 27652 consensus_queue.cc:1035] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.656250 27651 raft_consensus.cc:482] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.656422 27651 raft_consensus.cc:504] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.657035 27651 leader_election.cc:288] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.657871 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.658066 27420 raft_consensus.cc:2454] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.658324 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.658458 27537 leader_election.cc:302] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.658542 27498 raft_consensus.cc:2454] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.658746 27651 raft_consensus.cc:2781] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.658841 27651 raft_consensus.cc:482] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20240501 08:11:37.658900 27369 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 08:11:37.658972 27651 raft_consensus.cc:3037] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.661906 27651 raft_consensus.cc:504] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.663540 27651 leader_election.cc:288] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.664381 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.664661 27420 raft_consensus.cc:3037] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.667498 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ac20effe8284a15b83bc3fd1a72d8c8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.667793 27498 raft_consensus.cc:3037] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.673215 27498 raft_consensus.cc:2454] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.673637 27538 leader_election.cc:302] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.673923 27651 raft_consensus.cc:2781] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.674103 27651 raft_consensus.cc:686] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.674412 27651 consensus_queue.cc:237] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.678225 27420 raft_consensus.cc:2454] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.686292 27675 consensus_queue.cc:1035] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.691457 27644 raft_consensus.cc:482] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.691671 27644 raft_consensus.cc:504] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.693490 27644 leader_election.cc:288] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.693934 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.694289 27569 raft_consensus.cc:2379] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:37.695699 27644 consensus_queue.cc:1035] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.703398 27644 raft_consensus.cc:482] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.703642 27644 raft_consensus.cc:504] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.704843 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.705021 27644 leader_election.cc:288] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.705536 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:37.705641 27463 leader_election.cc:341] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:37.706108 27462 leader_election.cc:341] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.706269 27462 leader_election.cc:302] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.707929 27644 raft_consensus.cc:2726] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.712469 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1583f6f65abf4411a937349cff09bb6b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.713587 27463 leader_election.cc:302] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.714233 27644 raft_consensus.cc:3037] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.727944 27675 consensus_queue.cc:1035] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 08:11:37.731452 27389 consensus_peers.cc:485] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 -> Peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Couldn't send request to peer 8547734889f841dbbbff809909a0fc3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:37.738448 27709 consensus_queue.cc:1035] T 8c323e11ee98466ca9267923970d59a3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.743744 27648 raft_consensus.cc:482] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.744024 27648 raft_consensus.cc:504] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.744938 27648 leader_election.cc:288] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.746618 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.747215 27538 leader_election.cc:341] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.748601 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.748929 27420 raft_consensus.cc:2454] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.749444 27537 leader_election.cc:302] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.750073 27648 raft_consensus.cc:2781] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.750205 27648 raft_consensus.cc:482] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.750342 27648 raft_consensus.cc:3037] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.753911 27648 raft_consensus.cc:504] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.755195 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:37.755792 27538 leader_election.cc:341] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.756031 27648 leader_election.cc:288] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.756618 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.756879 27423 raft_consensus.cc:3037] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.760831 27423 raft_consensus.cc:2454] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.761492 27537 leader_election.cc:302] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.762073 27648 raft_consensus.cc:2781] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.762449 27648 raft_consensus.cc:686] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.762835 27648 consensus_queue.cc:237] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.768044 27709 consensus_queue.cc:1035] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.775928 27642 consensus_queue.cc:1035] T 55af818a67e6497ebfb9d17139081e95 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.790199 27709 consensus_queue.cc:1035] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.792964 27617 raft_consensus.cc:482] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.793205 27617 raft_consensus.cc:504] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.794023 27617 leader_election.cc:288] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.794407 27617 raft_consensus.cc:482] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.794620 27617 raft_consensus.cc:504] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.795475 27617 leader_election.cc:288] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.796350 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
W20240501 08:11:37.797566 27537 leader_election.cc:341] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.798288 27494 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.799571 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8d4c7a91a1440b1b8c2cb6d749c44f8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.799811 27497 raft_consensus.cc:2454] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
W20240501 08:11:37.800331 27538 leader_election.cc:341] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.800491 27538 leader_election.cc:302] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:37.801457 27801 raft_consensus.cc:2726] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.808820 27538 leader_election.cc:302] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.809134 27801 raft_consensus.cc:2781] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.809255 27801 raft_consensus.cc:482] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.809374 27801 raft_consensus.cc:3037] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.809477 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8d4c7a91a1440b1b8c2cb6d749c44f8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.809715 27423 raft_consensus.cc:2454] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:37.811247 27709 consensus_queue.cc:1035] T 9f924880fbff49f6a9bb7a1397a77963 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.814594 27801 raft_consensus.cc:504] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.818635 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8d4c7a91a1440b1b8c2cb6d749c44f8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:37.818920 27497 raft_consensus.cc:3037] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.820233 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8d4c7a91a1440b1b8c2cb6d749c44f8" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:37.820432 27423 raft_consensus.cc:3037] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.822113 27497 raft_consensus.cc:2454] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.823045 27538 leader_election.cc:302] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:37.823628 27497 raft_consensus.cc:3037] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.828409 27629 raft_consensus.cc:482] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.828615 27629 raft_consensus.cc:504] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.829803 27629 leader_election.cc:288] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.830659 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.831688 27709 consensus_queue.cc:1035] T 11ad813120804c88ac5c8f7b08b21c84 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.835253 27801 leader_election.cc:288] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:37.839692 27566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11ad813120804c88ac5c8f7b08b21c84" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.840535 27462 leader_election.cc:302] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.843003 27423 raft_consensus.cc:2454] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:37.852793 27709 raft_consensus.cc:482] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.853080 27709 raft_consensus.cc:504] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.854408 27709 leader_election.cc:288] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.855110 27566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:37.855695 27387 leader_election.cc:341] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.856107 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.856647 27389 leader_election.cc:341] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.856804 27389 leader_election.cc:302] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.857348 27709 raft_consensus.cc:2726] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.872915 27651 raft_consensus.cc:2781] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:37.873111 27651 raft_consensus.cc:686] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:37.873483 27651 consensus_queue.cc:237] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.881166 27644 raft_consensus.cc:2726] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.882550 27709 consensus_queue.cc:1035] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.889974 27709 consensus_queue.cc:1035] T ff6df2ff96c6444bb8b2d8d01065148c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:37.914321 27709 raft_consensus.cc:482] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.914605 27709 raft_consensus.cc:504] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.916126 27496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:37.916743 27389 leader_election.cc:341] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.921099 27321 catalog_manager.cc:5484] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:37.938084 27709 leader_election.cc:288] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.948874 27644 raft_consensus.cc:482] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.949105 27644 raft_consensus.cc:504] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.950493 27644 leader_election.cc:288] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.950822 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:37.953696 27423 raft_consensus.cc:2454] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:37.954226 27463 leader_election.cc:302] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:37.954835 27629 raft_consensus.cc:2726] T 11ad813120804c88ac5c8f7b08b21c84 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20240501 08:11:37.955181 27629 raft_consensus.cc:2781] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:37.955334 27629 raft_consensus.cc:482] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:37.955457 27629 raft_consensus.cc:3037] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:37.969980 27624 raft_consensus.cc:482] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:37.970155 27624 raft_consensus.cc:504] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:37.970923 27624 leader_election.cc:288] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:37.971856 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:37.972105 27496 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20240501 08:11:37.972299 27387 leader_election.cc:341] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.971884 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:37.972543 27624 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 08:11:37.973480 27389 leader_election.cc:341] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:37.973629 27389 leader_election.cc:302] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:37.974064 27624 raft_consensus.cc:2726] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:37.992085 27675 consensus_queue.cc:1035] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.012964 27570 raft_consensus.cc:3032] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Stepping down as leader of term 1
I20240501 08:11:38.013155 27570 raft_consensus.cc:729] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:38.013507 27570 consensus_queue.cc:260] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.013890 27570 raft_consensus.cc:3037] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Advancing to term 2
I20240501 08:11:38.017791 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.018353 27387 leader_election.cc:341] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.018479 27387 leader_election.cc:302] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.018895 27570 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20240501 08:11:38.018935 27652 raft_consensus.cc:2726] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.019013 27570 pending_rounds.cc:76] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Aborting all ops after (but not including) 0
I20240501 08:11:38.019088 27570 pending_rounds.cc:97] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20240501 08:11:38.019209 27570 raft_consensus.cc:2866] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20240501 08:11:38.020980 27709 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20240501 08:11:38.035569 27538 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.25.181.130:39237, user_credentials={real_user=slave}} blocked reactor thread for 212564us
I20240501 08:11:38.040220 27613 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.040390 27613 ts_tablet_manager.cc:1367] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.408s user 0.065s sys 0.130s
I20240501 08:11:38.040316 27810 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.041193 27613 raft_consensus.cc:348] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.041381 27613 raft_consensus.cc:374] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.041450 27613 raft_consensus.cc:729] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.041658 27613 consensus_queue.cc:260] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.042179 27613 ts_tablet_manager.cc:1398] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:38.042537 27613 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.043805 27612 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.043965 27612 ts_tablet_manager.cc:1367] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.417s user 0.050s sys 0.141s
I20240501 08:11:38.044703 27613 tablet_bootstrap.cc:654] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.048221 27629 raft_consensus.cc:504] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.048638 27709 consensus_queue.cc:1035] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.049535 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.049782 27420 raft_consensus.cc:3037] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.050668 27321 catalog_manager.cc:5484] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.051426 27321 catalog_manager.cc:5484] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.052047 27321 catalog_manager.cc:5484] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.052531 27676 consensus_queue.cc:1035] T 6615e3386cc24130a48c758a6e3064dd P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.052729 27629 leader_election.cc:288] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.055311 27613 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.055452 27613 ts_tablet_manager.cc:1367] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
W20240501 08:11:38.059645 27462 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.25.181.131:39407, user_credentials={real_user=slave}} blocked reactor thread for 136537us
I20240501 08:11:38.060026 27613 raft_consensus.cc:348] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.060286 27613 raft_consensus.cc:374] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.060361 27613 raft_consensus.cc:729] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.060631 27613 consensus_queue.cc:260] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.061385 27613 ts_tablet_manager.cc:1398] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:38.061739 27613 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.062829 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.063655 27613 tablet_bootstrap.cc:654] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.069481 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.044795 27612 raft_consensus.cc:348] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.070358 27612 raft_consensus.cc:374] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.070444 27612 raft_consensus.cc:729] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.052553 27420 raft_consensus.cc:2454] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
W20240501 08:11:38.071151 27387 consensus_peers.cc:485] T a99b775bfcce42cead10cc95ceff2174 P 221d03143b8c485bb23ea0460fd63c93 -> Peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Couldn't send request to peer ea3c290047e7442da83cf10d6c197e05. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:38.071169 27463 leader_election.cc:302] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
W20240501 08:11:38.071357 27462 leader_election.cc:341] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.071770 27642 raft_consensus.cc:2781] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.072032 27642 raft_consensus.cc:686] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.072343 27642 consensus_queue.cc:237] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.074035 27612 consensus_queue.cc:260] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:38.071756 27462 leader_election.cc:341] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.076694 27612 ts_tablet_manager.cc:1398] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.033s user 0.003s sys 0.000s
I20240501 08:11:38.077051 27612 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.079244 27652 raft_consensus.cc:482] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.079403 27652 raft_consensus.cc:504] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.080127 27652 leader_election.cc:288] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.080709 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.080900 27811 raft_consensus.cc:482] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.080933 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.081028 27811 raft_consensus.cc:504] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:38.081440 27389 leader_election.cc:341] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.082058 27493 raft_consensus.cc:1226] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Rejecting Update request from peer ea3c290047e7442da83cf10d6c197e05 for earlier term 1. Current term is 2. Ops: []
I20240501 08:11:38.080922 27568 raft_consensus.cc:2454] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.082985 27387 leader_election.cc:302] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.083263 27709 raft_consensus.cc:2781] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.083395 27709 raft_consensus.cc:482] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.083487 27709 raft_consensus.cc:3037] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.089536 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.088819 27811 leader_election.cc:288] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.091086 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d891a5adbb24e6293e0303b656ddc5a" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.089543 27612 tablet_bootstrap.cc:654] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.093410 27420 raft_consensus.cc:2379] T 6d891a5adbb24e6293e0303b656ddc5a P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate ea3c290047e7442da83cf10d6c197e05 in this term.
I20240501 08:11:38.094144 27463 leader_election.cc:302] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.095552 27811 raft_consensus.cc:3037] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.097708 27810 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.108320 27811 raft_consensus.cc:2726] T 6d891a5adbb24e6293e0303b656ddc5a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.110204 27709 raft_consensus.cc:504] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.112051 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:38.112586 27389 leader_election.cc:341] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.113303 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.113584 27570 raft_consensus.cc:3037] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.116446 27709 leader_election.cc:288] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.118605 27570 raft_consensus.cc:2454] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.118913 27387 leader_election.cc:302] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.118873 27804 consensus_queue.cc:1035] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.119344 27709 raft_consensus.cc:2781] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.120944 27612 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.122095 27612 ts_tablet_manager.cc:1367] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.002s
I20240501 08:11:38.119922 27709 raft_consensus.cc:686] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.122342 27613 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.122443 27613 ts_tablet_manager.cc:1367] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.061s user 0.008s sys 0.018s
I20240501 08:11:38.122473 27709 consensus_queue.cc:237] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.125144 27613 raft_consensus.cc:348] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.125676 27613 raft_consensus.cc:374] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.125803 27613 raft_consensus.cc:729] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.125972 27612 raft_consensus.cc:348] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.126195 27612 raft_consensus.cc:374] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.126264 27612 raft_consensus.cc:729] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.126085 27613 consensus_queue.cc:260] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.126487 27612 consensus_queue.cc:260] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.126988 27613 ts_tablet_manager.cc:1398] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:11:38.127108 27612 ts_tablet_manager.cc:1398] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 08:11:38.127426 27613 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.127655 27318 catalog_manager.cc:5484] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.127439 27612 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.129348 27612 tablet_bootstrap.cc:654] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.130834 27623 tablet_bootstrap.cc:492] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.130966 27623 ts_tablet_manager.cc:1367] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.506s user 0.128s sys 0.240s
I20240501 08:11:38.131666 27623 raft_consensus.cc:348] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.131922 27623 raft_consensus.cc:374] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.131990 27623 raft_consensus.cc:729] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.132243 27623 consensus_queue.cc:260] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.132972 27623 ts_tablet_manager.cc:1398] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.133330 27623 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.135035 27613 tablet_bootstrap.cc:654] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.135030 27623 tablet_bootstrap.cc:654] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.137379 27612 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.137516 27612 ts_tablet_manager.cc:1367] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.002s
I20240501 08:11:38.138283 27612 raft_consensus.cc:348] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.138525 27612 raft_consensus.cc:374] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.138590 27612 raft_consensus.cc:729] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.138789 27612 consensus_queue.cc:260] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.139408 27612 ts_tablet_manager.cc:1398] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:38.139709 27612 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.141197 27612 tablet_bootstrap.cc:654] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.141738 27809 consensus_queue.cc:1035] T 6d891a5adbb24e6293e0303b656ddc5a P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.144201 27652 raft_consensus.cc:482] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.144433 27612 tablet_bootstrap.cc:492] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.144351 27652 raft_consensus.cc:504] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.144541 27612 ts_tablet_manager.cc:1367] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 08:11:38.144951 27652 leader_election.cc:288] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.145205 27612 raft_consensus.cc:348] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.145382 27612 raft_consensus.cc:374] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.145440 27612 raft_consensus.cc:729] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.145643 27612 consensus_queue.cc:260] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.145762 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.146214 27389 leader_election.cc:341] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.146282 27612 ts_tablet_manager.cc:1398] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.146589 27612 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.146708 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.147825 27387 leader_election.cc:341] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.147958 27387 leader_election.cc:302] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.148761 27612 tablet_bootstrap.cc:654] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.149410 27809 consensus_queue.cc:1035] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.150116 27675 raft_consensus.cc:2726] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.153081 27318 catalog_manager.cc:5484] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.167788 27623 tablet_bootstrap.cc:492] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.168095 27623 ts_tablet_manager.cc:1367] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.009s
I20240501 08:11:38.169102 27623 raft_consensus.cc:348] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.169593 27623 raft_consensus.cc:374] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.169759 27623 raft_consensus.cc:729] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.170099 27623 consensus_queue.cc:260] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.171600 27629 raft_consensus.cc:482] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.171777 27629 raft_consensus.cc:504] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.172611 27629 leader_election.cc:288] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.173170 27623 ts_tablet_manager.cc:1398] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:38.173611 27623 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.174252 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.175879 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6df2ff96c6444bb8b2d8d01065148c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.176393 27463 leader_election.cc:302] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.176808 27629 raft_consensus.cc:2726] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.180595 27613 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.180766 27613 ts_tablet_manager.cc:1367] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.053s user 0.016s sys 0.009s
I20240501 08:11:38.181608 27613 raft_consensus.cc:348] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.181836 27613 raft_consensus.cc:374] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.181900 27613 raft_consensus.cc:729] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.182889 27613 consensus_queue.cc:260] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.183641 27613 ts_tablet_manager.cc:1398] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:38.183912 27613 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.184654 27617 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.185467 27613 tablet_bootstrap.cc:654] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.187680 27623 tablet_bootstrap.cc:654] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.187916 27612 tablet_bootstrap.cc:492] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.188045 27612 ts_tablet_manager.cc:1367] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.042s user 0.013s sys 0.020s
I20240501 08:11:38.188517 27612 raft_consensus.cc:348] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.189149 27612 raft_consensus.cc:374] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.189206 27612 raft_consensus.cc:729] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.189409 27612 consensus_queue.cc:260] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.189976 27612 ts_tablet_manager.cc:1398] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:38.190759 27709 raft_consensus.cc:482] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.190896 27709 raft_consensus.cc:504] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.191833 27709 leader_election.cc:288] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.192363 27612 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.192332 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a4436843d54143b8c8d45ce309ca36" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.192549 27493 raft_consensus.cc:2454] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.193004 27389 leader_election.cc:302] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.193526 27652 raft_consensus.cc:2781] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.193603 27652 raft_consensus.cc:482] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.193673 27652 raft_consensus.cc:3037] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.193699 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a4436843d54143b8c8d45ce309ca36" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.193889 27568 raft_consensus.cc:2454] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
W20240501 08:11:38.196208 27538 consensus_peers.cc:485] T 2342377b202a4bfa97e58ee217f56bcc P ea3c290047e7442da83cf10d6c197e05 -> Peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Couldn't send request to peer 8547734889f841dbbbff809909a0fc3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:38.200083 27652 raft_consensus.cc:504] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.200840 27652 leader_election.cc:288] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.201439 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a4436843d54143b8c8d45ce309ca36" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.201645 27493 raft_consensus.cc:3037] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.203665 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2a4436843d54143b8c8d45ce309ca36" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.203878 27570 raft_consensus.cc:3037] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.211241 27570 raft_consensus.cc:2454] T a2a4436843d54143b8c8d45ce309ca36 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.211989 27387 leader_election.cc:302] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.212292 27652 raft_consensus.cc:2781] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.212455 27652 raft_consensus.cc:686] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.213282 27652 consensus_queue.cc:237] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:38.217799 27538 consensus_peers.cc:485] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 -> Peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Couldn't send request to peer 8547734889f841dbbbff809909a0fc3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:38.221225 27612 tablet_bootstrap.cc:654] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.221992 27493 raft_consensus.cc:2454] T a2a4436843d54143b8c8d45ce309ca36 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.230473 27623 tablet_bootstrap.cc:492] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.230504 27613 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.230764 27613 ts_tablet_manager.cc:1367] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.047s user 0.006s sys 0.022s
I20240501 08:11:38.231573 27612 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.231743 27612 ts_tablet_manager.cc:1367] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.001s
I20240501 08:11:38.231783 27613 raft_consensus.cc:348] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.232087 27613 raft_consensus.cc:374] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.232153 27613 raft_consensus.cc:729] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.232453 27613 consensus_queue.cc:260] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.232825 27612 raft_consensus.cc:348] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.233098 27612 raft_consensus.cc:374] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.233199 27612 raft_consensus.cc:729] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.233254 27613 ts_tablet_manager.cc:1398] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:38.233683 27613 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.233525 27612 consensus_queue.cc:260] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.230769 27623 ts_tablet_manager.cc:1367] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.057s user 0.015s sys 0.019s
I20240501 08:11:38.234369 27319 catalog_manager.cc:5484] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.234386 27612 ts_tablet_manager.cc:1398] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:38.235172 27612 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.235376 27623 raft_consensus.cc:348] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.235599 27623 raft_consensus.cc:374] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.235690 27623 raft_consensus.cc:729] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.235980 27613 tablet_bootstrap.cc:654] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.235960 27623 consensus_queue.cc:260] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.236681 27623 ts_tablet_manager.cc:1398] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:38.237036 27623 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.238745 27493 raft_consensus.cc:3037] T ff6df2ff96c6444bb8b2d8d01065148c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.242551 27623 tablet_bootstrap.cc:654] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.245012 27612 tablet_bootstrap.cc:654] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.247901 27709 raft_consensus.cc:482] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.248009 27709 raft_consensus.cc:504] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.250734 27613 tablet_bootstrap.cc:492] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.251645 27709 leader_election.cc:288] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.252069 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.252256 27570 raft_consensus.cc:2454] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.252373 27613 ts_tablet_manager.cc:1367] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20240501 08:11:38.252529 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.253304 27389 leader_election.cc:341] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.253790 27387 leader_election.cc:302] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.254386 27709 raft_consensus.cc:2781] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.254483 27709 raft_consensus.cc:482] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.254570 27709 raft_consensus.cc:3037] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.258846 27709 raft_consensus.cc:504] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.260581 27709 leader_election.cc:288] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.260543 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.261400 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.261587 27570 raft_consensus.cc:3037] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:11:38.262516 27389 leader_election.cc:341] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.262748 27612 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.262879 27612 ts_tablet_manager.cc:1367] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.006s
I20240501 08:11:38.263958 27612 raft_consensus.cc:348] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.264197 27612 raft_consensus.cc:374] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.264290 27612 raft_consensus.cc:729] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.264537 27612 consensus_queue.cc:260] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.265157 27570 raft_consensus.cc:2454] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.265194 27612 ts_tablet_manager.cc:1398] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.265543 27387 leader_election.cc:302] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.265705 27612 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.265925 27709 raft_consensus.cc:2781] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.266026 27709 raft_consensus.cc:686] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.266228 27709 consensus_queue.cc:237] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.267715 27613 raft_consensus.cc:348] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.267961 27613 raft_consensus.cc:374] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.268060 27613 raft_consensus.cc:729] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.268281 27613 consensus_queue.cc:260] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.272073 27613 ts_tablet_manager.cc:1398] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.020s user 0.001s sys 0.001s
I20240501 08:11:38.273317 27613 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.277863 27612 tablet_bootstrap.cc:654] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.278668 27319 catalog_manager.cc:5484] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.279628 27613 tablet_bootstrap.cc:654] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.283886 27623 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.284093 27623 ts_tablet_manager.cc:1367] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.006s
I20240501 08:11:38.285037 27623 raft_consensus.cc:348] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.285373 27623 raft_consensus.cc:374] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.285475 27623 raft_consensus.cc:729] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.285781 27623 consensus_queue.cc:260] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.286154 27612 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.286293 27612 ts_tablet_manager.cc:1367] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.001s
I20240501 08:11:38.286589 27709 raft_consensus.cc:482] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.286701 27709 raft_consensus.cc:504] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.287117 27612 raft_consensus.cc:348] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.287334 27709 leader_election.cc:288] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.287693 27623 ts_tablet_manager.cc:1398] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:38.287904 27613 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.288043 27613 ts_tablet_manager.cc:1367] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20240501 08:11:38.288100 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.288360 27570 raft_consensus.cc:2454] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.288790 27613 raft_consensus.cc:348] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.288852 27387 leader_election.cc:302] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.288946 27613 raft_consensus.cc:374] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.289000 27613 raft_consensus.cc:729] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.289222 27709 raft_consensus.cc:2781] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.289309 27709 raft_consensus.cc:482] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.287345 27612 raft_consensus.cc:374] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.289397 27709 raft_consensus.cc:3037] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.289433 27612 raft_consensus.cc:729] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.289197 27613 consensus_queue.cc:260] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.290023 27613 ts_tablet_manager.cc:1398] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.290270 27613 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.291440 27612 consensus_queue.cc:260] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.291940 27612 ts_tablet_manager.cc:1398] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:38.292711 27612 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.292754 27709 raft_consensus.cc:504] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.293421 27709 leader_election.cc:288] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.288100 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.294080 27493 raft_consensus.cc:2454] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.294250 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.294361 27623 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.293929 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "788dbb1243e348eaacdedb75aefa7691" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.294435 27570 raft_consensus.cc:3037] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.294708 27495 raft_consensus.cc:3037] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.294813 27613 tablet_bootstrap.cc:654] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.294461 27612 tablet_bootstrap.cc:654] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.296825 27495 raft_consensus.cc:2454] T 788dbb1243e348eaacdedb75aefa7691 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.296823 27570 raft_consensus.cc:2454] T 788dbb1243e348eaacdedb75aefa7691 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.297044 27809 raft_consensus.cc:482] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.297151 27809 raft_consensus.cc:504] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.297617 27809 leader_election.cc:288] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.297899 27389 leader_election.cc:302] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.298159 27709 raft_consensus.cc:2781] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.298278 27709 raft_consensus.cc:686] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.298517 27709 consensus_queue.cc:237] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.298925 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.299539 27809 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.299739 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a99b775bfcce42cead10cc95ceff2174" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.300324 27538 leader_election.cc:302] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.300539 27809 raft_consensus.cc:2726] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.301955 27809 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.304841 27623 tablet_bootstrap.cc:654] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.305879 27809 raft_consensus.cc:482] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.306021 27809 raft_consensus.cc:504] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.306779 27809 leader_election.cc:288] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.307112 27319 catalog_manager.cc:5484] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.309882 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.310204 27423 raft_consensus.cc:2379] T eb7f1d58a88745faa02205086a758098 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3c290047e7442da83cf10d6c197e05 in current term 1: Already voted for candidate 8547734889f841dbbbff809909a0fc3b in this term.
I20240501 08:11:38.311141 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb7f1d58a88745faa02205086a758098" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.311761 27538 leader_election.cc:302] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.312201 27809 raft_consensus.cc:3037] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.315774 27809 raft_consensus.cc:2726] T eb7f1d58a88745faa02205086a758098 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.321182 27612 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.321321 27612 ts_tablet_manager.cc:1367] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.009s
I20240501 08:11:38.322085 27612 raft_consensus.cc:348] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.322288 27612 raft_consensus.cc:374] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.322364 27612 raft_consensus.cc:729] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.322615 27612 consensus_queue.cc:260] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.323217 27612 ts_tablet_manager.cc:1398] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.324605 27629 raft_consensus.cc:482] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.324786 27629 raft_consensus.cc:504] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.325529 27629 leader_election.cc:288] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.326498 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.327186 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200c3f11ec194af394c1c130d22a9663" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.327741 27463 leader_election.cc:302] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.327986 27612 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.328199 27629 raft_consensus.cc:2726] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.328920 27623 tablet_bootstrap.cc:492] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.329077 27623 ts_tablet_manager.cc:1367] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.000s
I20240501 08:11:38.329808 27612 tablet_bootstrap.cc:654] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.330039 27623 raft_consensus.cc:348] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.330302 27623 raft_consensus.cc:374] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.330370 27623 raft_consensus.cc:729] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.336433 27623 consensus_queue.cc:260] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.338985 27623 ts_tablet_manager.cc:1398] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s
I20240501 08:11:38.339370 27623 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.336769 27612 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.339634 27612 ts_tablet_manager.cc:1367] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20240501 08:11:38.340796 27612 raft_consensus.cc:348] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.341030 27612 raft_consensus.cc:374] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.341138 27612 raft_consensus.cc:729] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.341372 27612 consensus_queue.cc:260] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.342554 27804 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.343138 27612 ts_tablet_manager.cc:1398] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:38.343466 27612 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.345605 27612 tablet_bootstrap.cc:654] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.348246 27613 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.348513 27613 ts_tablet_manager.cc:1367] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.010s
I20240501 08:11:38.349192 27613 raft_consensus.cc:348] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.349454 27613 raft_consensus.cc:374] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.349571 27613 raft_consensus.cc:729] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.349740 27623 tablet_bootstrap.cc:654] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.349866 27613 consensus_queue.cc:260] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.350457 27613 ts_tablet_manager.cc:1398] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.350798 27613 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.352792 27613 tablet_bootstrap.cc:654] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.363790 27623 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.363993 27623 ts_tablet_manager.cc:1367] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20240501 08:11:38.365068 27613 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.365010 27623 raft_consensus.cc:348] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.365216 27613 ts_tablet_manager.cc:1367] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20240501 08:11:38.365255 27623 raft_consensus.cc:374] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.365340 27623 raft_consensus.cc:729] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.365614 27623 consensus_queue.cc:260] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.366003 27613 raft_consensus.cc:348] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.366222 27613 raft_consensus.cc:374] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.366315 27613 raft_consensus.cc:729] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.366427 27803 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.366534 27613 consensus_queue.cc:260] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.367159 27613 ts_tablet_manager.cc:1398] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:38.367478 27623 ts_tablet_manager.cc:1398] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:38.367839 27623 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.367871 27612 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.368034 27612 ts_tablet_manager.cc:1367] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.005s
I20240501 08:11:38.368809 27612 raft_consensus.cc:348] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.369036 27612 raft_consensus.cc:374] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.369148 27612 raft_consensus.cc:729] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.369419 27612 consensus_queue.cc:260] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.370046 27623 tablet_bootstrap.cc:654] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.371107 27613 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.371304 27612 ts_tablet_manager.cc:1398] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:38.371611 27612 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.373418 27612 tablet_bootstrap.cc:654] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.373638 27613 tablet_bootstrap.cc:654] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.394574 27613 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.394580 27612 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.395004 27612 ts_tablet_manager.cc:1367] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.023s user 0.007s sys 0.009s
I20240501 08:11:38.395009 27613 ts_tablet_manager.cc:1367] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.008s
I20240501 08:11:38.396044 27613 raft_consensus.cc:348] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.396207 27612 raft_consensus.cc:348] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.396792 27612 raft_consensus.cc:374] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.396803 27613 raft_consensus.cc:374] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.396912 27612 raft_consensus.cc:729] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.397079 27613 raft_consensus.cc:729] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.397184 27612 consensus_queue.cc:260] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.397446 27613 consensus_queue.cc:260] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.397797 27612 ts_tablet_manager.cc:1398] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:38.398109 27613 ts_tablet_manager.cc:1398] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:38.398267 27612 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.398463 27613 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.401765 27612 tablet_bootstrap.cc:654] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.401937 27613 tablet_bootstrap.cc:654] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.410017 27612 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.410228 27612 ts_tablet_manager.cc:1367] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.007s
I20240501 08:11:38.411516 27612 raft_consensus.cc:348] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.411845 27612 raft_consensus.cc:374] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.411934 27612 raft_consensus.cc:729] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.412194 27612 consensus_queue.cc:260] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.412743 27612 ts_tablet_manager.cc:1398] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.413194 27623 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.413308 27612 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.413448 27623 ts_tablet_manager.cc:1367] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.018s
I20240501 08:11:38.414281 27623 raft_consensus.cc:348] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.414563 27623 raft_consensus.cc:374] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.414724 27623 raft_consensus.cc:729] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.415071 27623 consensus_queue.cc:260] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.416635 27612 tablet_bootstrap.cc:654] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.418917 27623 ts_tablet_manager.cc:1398] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240501 08:11:38.420469 27629 raft_consensus.cc:482] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.420657 27629 raft_consensus.cc:504] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.421566 27629 leader_election.cc:288] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.422677 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.422928 27570 raft_consensus.cc:2379] T 9d1fd9ea5e73497fbc56acc71dade295 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:38.423223 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d1fd9ea5e73497fbc56acc71dade295" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.424062 27462 leader_election.cc:302] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.424435 27623 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.424616 27629 raft_consensus.cc:3037] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.426374 27623 tablet_bootstrap.cc:654] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.427939 27629 raft_consensus.cc:2726] T 9d1fd9ea5e73497fbc56acc71dade295 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.430881 27612 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.431072 27612 ts_tablet_manager.cc:1367] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.002s
I20240501 08:11:38.432279 27623 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.432142 27612 raft_consensus.cc:348] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.432456 27623 ts_tablet_manager.cc:1367] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20240501 08:11:38.432495 27613 tablet_bootstrap.cc:492] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.432674 27613 ts_tablet_manager.cc:1367] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.013s
I20240501 08:11:38.433142 27623 raft_consensus.cc:348] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.432458 27612 raft_consensus.cc:374] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.433494 27612 raft_consensus.cc:729] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.433530 27623 raft_consensus.cc:374] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.433629 27623 raft_consensus.cc:729] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.433698 27613 raft_consensus.cc:348] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.433888 27613 raft_consensus.cc:374] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.433823 27612 consensus_queue.cc:260] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.434012 27613 raft_consensus.cc:729] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.433964 27623 consensus_queue.cc:260] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.434440 27612 ts_tablet_manager.cc:1398] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:38.434485 27623 ts_tablet_manager.cc:1398] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.434849 27612 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.434737 27613 consensus_queue.cc:260] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.437918 27804 raft_consensus.cc:482] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.438045 27804 raft_consensus.cc:504] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.438588 27804 leader_election.cc:288] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.438999 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.439213 27420 raft_consensus.cc:2454] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.439692 27537 leader_election.cc:302] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.439996 27804 raft_consensus.cc:2781] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.440080 27804 raft_consensus.cc:482] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.440158 27804 raft_consensus.cc:3037] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.440783 27613 ts_tablet_manager.cc:1398] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240501 08:11:38.441056 27613 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.442799 27613 tablet_bootstrap.cc:654] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.448554 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.449728 27538 leader_election.cc:341] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.449919 27652 raft_consensus.cc:482] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.450053 27652 raft_consensus.cc:504] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.450681 27652 leader_election.cc:288] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.451031 27623 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.453125 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.453277 27623 tablet_bootstrap.cc:654] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
W20240501 08:11:38.453899 27389 leader_election.cc:341] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.454509 27804 raft_consensus.cc:504] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.455252 27811 consensus_queue.cc:1035] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.455468 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:38.455899 27538 leader_election.cc:341] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.455912 27809 raft_consensus.cc:482] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.456099 27804 leader_election.cc:288] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.456056 27809 raft_consensus.cc:504] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.456426 27612 tablet_bootstrap.cc:654] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.456578 27809 leader_election.cc:288] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.457120 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.457216 27652 raft_consensus.cc:482] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.457326 27652 raft_consensus.cc:504] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.457897 27652 leader_election.cc:288] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.457955 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.458127 27568 raft_consensus.cc:2454] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.458262 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.458420 27423 raft_consensus.cc:3037] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.458458 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.459043 27623 tablet_bootstrap.cc:492] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.459173 27623 ts_tablet_manager.cc:1367] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20240501 08:11:38.459738 27623 raft_consensus.cc:348] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.459872 27623 raft_consensus.cc:374] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.459928 27623 raft_consensus.cc:729] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.460139 27623 consensus_queue.cc:260] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.460629 27623 ts_tablet_manager.cc:1398] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240501 08:11:38.460862 27623 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.462038 27623 tablet_bootstrap.cc:654] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.462798 27423 raft_consensus.cc:2454] T 739e5b2ab7a64581b57f3e9b0e58e87c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.463770 27613 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.463920 27613 ts_tablet_manager.cc:1367] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.003s
I20240501 08:11:38.464255 27623 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.464359 27623 ts_tablet_manager.cc:1367] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:38.464640 27613 raft_consensus.cc:348] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.464838 27613 raft_consensus.cc:374] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.464895 27613 raft_consensus.cc:729] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.465073 27613 consensus_queue.cc:260] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.465391 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.465917 27538 leader_election.cc:341] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.467468 27387 leader_election.cc:302] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.467958 27652 raft_consensus.cc:2781] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.468046 27652 raft_consensus.cc:482] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.468104 27652 raft_consensus.cc:3037] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
W20240501 08:11:38.468557 27389 leader_election.cc:341] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:38.468938 27537 leader_election.cc:341] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.469048 27537 leader_election.cc:302] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.469347 27623 raft_consensus.cc:348] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.469532 27623 raft_consensus.cc:374] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.469576 27623 raft_consensus.cc:729] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.469595 27537 leader_election.cc:302] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.469841 27804 raft_consensus.cc:2726] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.469777 27623 consensus_queue.cc:260] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.469974 27804 raft_consensus.cc:2781] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.470069 27804 raft_consensus.cc:686] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:38.470278 27804 consensus_queue.cc:237] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.470801 27652 raft_consensus.cc:504] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.471124 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.471242 27623 ts_tablet_manager.cc:1398] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240501 08:11:38.471573 27623 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.465546 27613 ts_tablet_manager.cc:1398] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:38.471890 27613 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.472574 27811 consensus_queue.cc:1035] T eb7f1d58a88745faa02205086a758098 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.473305 27613 tablet_bootstrap.cc:654] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.473305 27623 tablet_bootstrap.cc:654] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
W20240501 08:11:38.471900 27387 leader_election.cc:341] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.474586 27387 leader_election.cc:302] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.475106 27624 raft_consensus.cc:2726] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.475520 27652 leader_election.cc:288] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.475826 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.476542 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.476686 27613 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.476730 27570 raft_consensus.cc:3037] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.476830 27613 ts_tablet_manager.cc:1367] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
W20240501 08:11:38.476831 27389 leader_election.cc:341] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.477553 27613 raft_consensus.cc:348] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.477722 27613 raft_consensus.cc:374] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.477772 27613 raft_consensus.cc:729] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.478389 27613 consensus_queue.cc:260] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.479310 27613 ts_tablet_manager.cc:1398] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.479656 27613 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.480082 27652 raft_consensus.cc:482] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.480232 27652 raft_consensus.cc:504] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.480696 27570 raft_consensus.cc:2454] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.481030 27652 leader_election.cc:288] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.481429 27387 leader_election.cc:302] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.481755 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ccea69adc48058e2f17dd9901eb8a" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.481972 27567 raft_consensus.cc:2454] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.482314 27387 leader_election.cc:302] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.482482 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ccea69adc48058e2f17dd9901eb8a" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.482610 27709 raft_consensus.cc:2781] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.482694 27495 raft_consensus.cc:2454] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.482841 27624 raft_consensus.cc:2781] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.482906 27624 raft_consensus.cc:482] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.482972 27624 raft_consensus.cc:3037] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.482731 27709 raft_consensus.cc:686] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.483593 27709 consensus_queue.cc:237] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.486254 27613 tablet_bootstrap.cc:654] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.486310 27623 tablet_bootstrap.cc:492] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.487118 27623 ts_tablet_manager.cc:1367] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.004s
I20240501 08:11:38.487730 27623 raft_consensus.cc:348] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.487870 27623 raft_consensus.cc:374] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.487927 27623 raft_consensus.cc:729] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.488128 27623 consensus_queue.cc:260] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.488586 27623 ts_tablet_manager.cc:1398] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:38.488888 27623 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.489766 27624 raft_consensus.cc:504] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.490408 27623 tablet_bootstrap.cc:654] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.490582 27624 leader_election.cc:288] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.491436 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ccea69adc48058e2f17dd9901eb8a" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.491624 27495 raft_consensus.cc:3037] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.492154 27613 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.492264 27613 ts_tablet_manager.cc:1367] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240501 08:11:38.492861 27613 raft_consensus.cc:348] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.493055 27613 raft_consensus.cc:374] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.493101 27613 raft_consensus.cc:729] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.493271 27613 consensus_queue.cc:260] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.494129 27613 ts_tablet_manager.cc:1398] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.494334 27495 raft_consensus.cc:2454] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.494390 27613 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.494971 27389 leader_election.cc:302] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.494966 27811 raft_consensus.cc:482] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.495483 27811 raft_consensus.cc:504] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.496240 27613 tablet_bootstrap.cc:654] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.495348 27675 raft_consensus.cc:2781] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.496429 27675 raft_consensus.cc:686] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.496757 27675 consensus_queue.cc:237] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.498286 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5ccea69adc48058e2f17dd9901eb8a" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.498502 27567 raft_consensus.cc:3037] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.496206 27811 leader_election.cc:288] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.498993 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.499686 27423 raft_consensus.cc:2454] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.500346 27463 leader_election.cc:302] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.500743 27811 raft_consensus.cc:2781] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.500857 27811 raft_consensus.cc:482] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.500938 27811 raft_consensus.cc:3037] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.502139 27567 raft_consensus.cc:2454] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.503041 27568 raft_consensus.cc:3037] T a99b775bfcce42cead10cc95ceff2174 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.503546 27676 raft_consensus.cc:482] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.503713 27676 raft_consensus.cc:504] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.504492 27676 leader_election.cc:288] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.505151 27676 raft_consensus.cc:482] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.505312 27676 raft_consensus.cc:504] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.506088 27676 leader_election.cc:288] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.506896 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.507354 27572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.507468 27389 leader_election.cc:341] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.507531 27572 raft_consensus.cc:2454] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.507776 27571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.507750 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.508383 27387 leader_election.cc:341] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:38.508602 27387 leader_election.cc:341] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.508684 27387 leader_election.cc:302] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.507776 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.509486 27389 leader_election.cc:341] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.509598 27389 leader_election.cc:302] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.510344 27676 raft_consensus.cc:2726] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.510511 27676 raft_consensus.cc:2726] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.510367 27811 raft_consensus.cc:504] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.512065 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.512295 27423 raft_consensus.cc:3037] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.512414 27318 catalog_manager.cc:5484] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.515708 27811 leader_election.cc:288] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.517412 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e121a0b28dc14dec962f98efc3f08137" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.517609 27569 raft_consensus.cc:3037] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.518067 27423 raft_consensus.cc:2454] T e121a0b28dc14dec962f98efc3f08137 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.518853 27463 leader_election.cc:302] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.519243 27811 raft_consensus.cc:2781] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.519960 27811 raft_consensus.cc:686] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.520375 27811 consensus_queue.cc:237] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.521112 27569 raft_consensus.cc:2454] T e121a0b28dc14dec962f98efc3f08137 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.539139 27318 catalog_manager.cc:5484] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.543763 27613 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.544095 27613 ts_tablet_manager.cc:1367] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.024s
I20240501 08:11:38.545251 27613 raft_consensus.cc:348] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.545778 27613 raft_consensus.cc:374] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.545943 27613 raft_consensus.cc:729] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.546291 27613 consensus_queue.cc:260] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.547210 27613 ts_tablet_manager.cc:1398] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:38.547703 27613 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.548096 27624 raft_consensus.cc:482] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.548274 27624 raft_consensus.cc:504] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.549119 27624 leader_election.cc:288] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.549664 27495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.550127 27389 leader_election.cc:341] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.550992 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.551731 27387 leader_election.cc:341] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.551877 27387 leader_election.cc:302] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.552649 27624 raft_consensus.cc:2726] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.553354 27629 raft_consensus.cc:482] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.553485 27629 raft_consensus.cc:504] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.554057 27629 leader_election.cc:288] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.555202 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.550994 27613 tablet_bootstrap.cc:654] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.558712 27612 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.558866 27612 ts_tablet_manager.cc:1367] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.124s user 0.008s sys 0.015s
I20240501 08:11:38.559602 27612 raft_consensus.cc:348] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.559789 27612 raft_consensus.cc:374] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.559856 27612 raft_consensus.cc:729] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.560072 27612 consensus_queue.cc:260] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.562294 27318 catalog_manager.cc:5484] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.563691 27612 ts_tablet_manager.cc:1398] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:38.563050 27318 catalog_manager.cc:5484] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.564862 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2342377b202a4bfa97e58ee217f56bcc" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.565366 27462 leader_election.cc:302] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.565784 27811 raft_consensus.cc:2726] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.566612 27612 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.568403 27612 tablet_bootstrap.cc:654] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.569840 27623 tablet_bootstrap.cc:492] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.570012 27623 ts_tablet_manager.cc:1367] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.081s user 0.025s sys 0.032s
I20240501 08:11:38.570902 27623 raft_consensus.cc:348] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.571167 27623 raft_consensus.cc:374] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.571226 27623 raft_consensus.cc:729] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.571530 27623 consensus_queue.cc:260] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.574956 27623 ts_tablet_manager.cc:1398] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240501 08:11:38.575385 27623 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.577658 27623 tablet_bootstrap.cc:654] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.579664 27612 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.579775 27612 ts_tablet_manager.cc:1367] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240501 08:11:38.580240 27623 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.580322 27612 raft_consensus.cc:348] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.580467 27612 raft_consensus.cc:374] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.580508 27612 raft_consensus.cc:729] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.580595 27623 ts_tablet_manager.cc:1367] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240501 08:11:38.580662 27612 consensus_queue.cc:260] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.581116 27612 ts_tablet_manager.cc:1398] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:38.581645 27613 tablet_bootstrap.cc:492] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.581740 27613 ts_tablet_manager.cc:1367] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.019s
I20240501 08:11:38.581549 27623 raft_consensus.cc:348] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.581925 27623 raft_consensus.cc:374] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.582032 27623 raft_consensus.cc:729] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.582149 27613 raft_consensus.cc:348] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.582283 27613 raft_consensus.cc:374] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.582319 27613 raft_consensus.cc:729] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.582473 27613 consensus_queue.cc:260] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.582458 27623 consensus_queue.cc:260] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.582918 27613 ts_tablet_manager.cc:1398] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:38.583256 27623 ts_tablet_manager.cc:1398] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240501 08:11:38.583626 27623 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.583797 27613 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.585335 27623 tablet_bootstrap.cc:654] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.585354 27613 tablet_bootstrap.cc:654] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.583626 27612 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.586980 27612 tablet_bootstrap.cc:654] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.597237 27613 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.597395 27613 ts_tablet_manager.cc:1367] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20240501 08:11:38.597723 27623 tablet_bootstrap.cc:492] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.597843 27623 ts_tablet_manager.cc:1367] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20240501 08:11:38.598088 27613 raft_consensus.cc:348] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.598306 27613 raft_consensus.cc:374] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.598368 27613 raft_consensus.cc:729] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.598397 27623 raft_consensus.cc:348] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.598565 27613 consensus_queue.cc:260] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.598552 27623 raft_consensus.cc:374] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.598942 27623 raft_consensus.cc:729] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.599180 27613 ts_tablet_manager.cc:1398] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.599148 27623 consensus_queue.cc:260] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.599444 27613 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.600651 27623 ts_tablet_manager.cc:1398] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:38.600893 27623 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.600986 27613 tablet_bootstrap.cc:654] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.601162 27612 tablet_bootstrap.cc:492] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.601284 27612 ts_tablet_manager.cc:1367] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20240501 08:11:38.602665 27495 raft_consensus.cc:3037] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.603920 27612 raft_consensus.cc:348] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.604077 27612 raft_consensus.cc:374] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.604117 27612 raft_consensus.cc:729] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.604271 27612 consensus_queue.cc:260] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.602710 27623 tablet_bootstrap.cc:654] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.604719 27612 ts_tablet_manager.cc:1398] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:38.604959 27612 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.602895 27809 raft_consensus.cc:482] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.606650 27809 raft_consensus.cc:504] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.607432 27809 leader_election.cc:288] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.608024 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.608275 27423 raft_consensus.cc:2454] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.608719 27537 leader_election.cc:302] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.609269 27612 tablet_bootstrap.cc:654] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.609342 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.609493 27493 raft_consensus.cc:2454] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.612738 27623 tablet_bootstrap.cc:492] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.612964 27623 ts_tablet_manager.cc:1367] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20240501 08:11:38.613214 27809 raft_consensus.cc:2781] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.613306 27809 raft_consensus.cc:482] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.613379 27809 raft_consensus.cc:3037] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.614064 27623 raft_consensus.cc:348] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.614315 27623 raft_consensus.cc:374] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.614377 27623 raft_consensus.cc:729] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.614912 27811 raft_consensus.cc:482] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.615051 27811 raft_consensus.cc:504] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.615898 27811 leader_election.cc:288] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.616585 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.616652 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.616808 27423 raft_consensus.cc:2454] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.616850 27568 raft_consensus.cc:2454] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.617271 27463 leader_election.cc:302] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.617937 27629 raft_consensus.cc:2781] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.618041 27629 raft_consensus.cc:482] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.618117 27629 raft_consensus.cc:3037] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.622965 27613 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.623116 27613 ts_tablet_manager.cc:1367] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.011s
I20240501 08:11:38.623864 27629 raft_consensus.cc:504] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.623838 27613 raft_consensus.cc:348] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.624056 27613 raft_consensus.cc:374] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.624110 27613 raft_consensus.cc:729] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.624141 27809 raft_consensus.cc:504] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.624293 27613 consensus_queue.cc:260] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.625007 27613 ts_tablet_manager.cc:1398] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.625075 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.625223 27423 raft_consensus.cc:3037] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.625322 27613 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.626979 27613 tablet_bootstrap.cc:654] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.628507 27423 raft_consensus.cc:2454] T 4fb611f9eafc4e109c6d0989d6c409e9 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.629002 27463 leader_election.cc:302] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.629340 27811 raft_consensus.cc:2781] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.629494 27811 raft_consensus.cc:686] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.629817 27811 consensus_queue.cc:237] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.632009 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fb611f9eafc4e109c6d0989d6c409e9" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.632192 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.632267 27568 raft_consensus.cc:3037] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.632373 27493 raft_consensus.cc:3037] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.635917 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ca8b6207ad64e53afc74b488e8eea32" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.636116 27629 leader_election.cc:288] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.636152 27420 raft_consensus.cc:3037] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.636947 27568 raft_consensus.cc:2454] T 4fb611f9eafc4e109c6d0989d6c409e9 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.614769 27623 consensus_queue.cc:260] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.640954 27623 ts_tablet_manager.cc:1398] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20240501 08:11:38.641310 27623 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.643455 27420 raft_consensus.cc:2454] T 6ca8b6207ad64e53afc74b488e8eea32 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.644058 27537 leader_election.cc:302] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.644261 27493 raft_consensus.cc:2454] T 6ca8b6207ad64e53afc74b488e8eea32 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.644400 27804 raft_consensus.cc:2781] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.644551 27804 raft_consensus.cc:686] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:38.644871 27804 consensus_queue.cc:237] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.645426 27809 leader_election.cc:288] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.646675 27624 consensus_queue.cc:1035] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.648208 27629 raft_consensus.cc:482] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.648383 27629 raft_consensus.cc:504] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.650840 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.651115 27420 raft_consensus.cc:2454] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.651965 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.652158 27567 raft_consensus.cc:2454] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.652498 27463 leader_election.cc:302] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.652863 27644 raft_consensus.cc:2781] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.652947 27644 raft_consensus.cc:482] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.653057 27644 raft_consensus.cc:3037] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.655016 27652 consensus_queue.cc:1035] T 9d1fd9ea5e73497fbc56acc71dade295 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.657509 27644 raft_consensus.cc:504] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.659222 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.659422 27567 raft_consensus.cc:3037] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.660341 27629 leader_election.cc:288] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.662091 27567 raft_consensus.cc:2454] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.662616 27462 leader_election.cc:302] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.662933 27644 leader_election.cc:288] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.663126 27644 raft_consensus.cc:2781] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.663729 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b078e697a866402083f8b9b79695016b" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.663990 27423 raft_consensus.cc:3037] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.666677 27423 raft_consensus.cc:2454] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
W20240501 08:11:38.666891 27369 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240501 08:11:38.667342 27644 raft_consensus.cc:686] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.667770 27644 consensus_queue.cc:237] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.669595 27629 raft_consensus.cc:482] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.669790 27629 raft_consensus.cc:504] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.670620 27629 leader_election.cc:288] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.671201 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.671473 27422 raft_consensus.cc:2454] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.672238 27463 leader_election.cc:302] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.672627 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.672927 27567 raft_consensus.cc:2454] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.673010 27642 raft_consensus.cc:2781] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.673156 27642 raft_consensus.cc:482] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.673305 27642 raft_consensus.cc:3037] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.677273 27642 raft_consensus.cc:504] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.678133 27642 leader_election.cc:288] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.678336 27642 raft_consensus.cc:482] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.678539 27642 raft_consensus.cc:504] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.679178 27642 leader_election.cc:288] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.692137 27623 tablet_bootstrap.cc:654] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
W20240501 08:11:38.698774 27389 consensus_peers.cc:485] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 -> Peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Couldn't send request to peer 8547734889f841dbbbff809909a0fc3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:38.700397 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.700691 27422 raft_consensus.cc:2454] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.700982 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.701238 27423 raft_consensus.cc:3037] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.701201 27463 leader_election.cc:302] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.704908 27624 consensus_queue.cc:1035] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.705051 27423 raft_consensus.cc:2454] T c6b91c6bda24445c8a0ec60f77733af6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.705664 27811 raft_consensus.cc:2781] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.711849 27811 raft_consensus.cc:482] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.711879 27624 raft_consensus.cc:482] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.713250 27624 raft_consensus.cc:504] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.713639 27811 raft_consensus.cc:3037] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.714203 27624 leader_election.cc:288] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.716302 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.716441 27463 leader_election.cc:302] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.716847 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.719918 27623 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
W20240501 08:11:38.719970 27389 leader_election.cc:341] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.720866 27642 raft_consensus.cc:2781] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.714846 27319 catalog_manager.cc:5484] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.722189 27496 raft_consensus.cc:3037] T 2342377b202a4bfa97e58ee217f56bcc P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.725476 27642 raft_consensus.cc:686] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.728781 27804 raft_consensus.cc:482] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.727167 27811 raft_consensus.cc:504] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.732658 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.733121 27811 leader_election.cc:288] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.737248 27652 consensus_queue.cc:1035] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.744905 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.752121 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
W20240501 08:11:38.754345 27387 leader_election.cc:341] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.754892 27387 leader_election.cc:302] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.755815 27642 consensus_queue.cc:237] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.757195 27652 raft_consensus.cc:2726] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.757688 27804 raft_consensus.cc:504] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.758143 27568 raft_consensus.cc:2454] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.758538 27804 leader_election.cc:288] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.759944 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.760234 27497 raft_consensus.cc:2379] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea3c290047e7442da83cf10d6c197e05 in current term 1: Already voted for candidate 8547734889f841dbbbff809909a0fc3b in this term.
I20240501 08:11:38.761904 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8aff03771b047a991c020cc628aa057" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.763561 27537 leader_election.cc:302] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea3c290047e7442da83cf10d6c197e05; no voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.766934 27623 ts_tablet_manager.cc:1367] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.079s user 0.003s sys 0.005s
I20240501 08:11:38.767627 27623 raft_consensus.cc:348] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.767861 27675 consensus_queue.cc:1035] T a2a4436843d54143b8c8d45ce309ca36 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.768347 27804 raft_consensus.cc:3037] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.768460 27612 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.768393 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6b91c6bda24445c8a0ec60f77733af6" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.768594 27567 raft_consensus.cc:3037] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.768630 27612 ts_tablet_manager.cc:1367] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.164s user 0.032s sys 0.033s
I20240501 08:11:38.769277 27612 raft_consensus.cc:348] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.769466 27612 raft_consensus.cc:374] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.769567 27612 raft_consensus.cc:729] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.769791 27612 consensus_queue.cc:260] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.770344 27612 ts_tablet_manager.cc:1398] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:38.770828 27612 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.771343 27624 consensus_queue.cc:1035] T 788dbb1243e348eaacdedb75aefa7691 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20240501 08:11:38.771862 27567 raft_consensus.cc:2454] T c6b91c6bda24445c8a0ec60f77733af6 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.772302 27423 raft_consensus.cc:3037] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.772650 27612 tablet_bootstrap.cc:654] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.775643 27423 raft_consensus.cc:2454] T b8aff03771b047a991c020cc628aa057 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.776528 27463 leader_election.cc:302] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters: ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.783479 27804 raft_consensus.cc:2726] T b8aff03771b047a991c020cc628aa057 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.784703 27612 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.784904 27612 ts_tablet_manager.cc:1367] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.002s
I20240501 08:11:38.785487 27612 raft_consensus.cc:348] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.785687 27612 raft_consensus.cc:374] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.785784 27612 raft_consensus.cc:729] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.786034 27612 consensus_queue.cc:260] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.786491 27612 ts_tablet_manager.cc:1398] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:38.786770 27612 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.787880 27623 raft_consensus.cc:374] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.788008 27623 raft_consensus.cc:729] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.788339 27612 tablet_bootstrap.cc:654] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.788317 27623 consensus_queue.cc:260] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.789543 27811 raft_consensus.cc:2781] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.789686 27811 raft_consensus.cc:686] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.789923 27811 consensus_queue.cc:237] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.791543 27612 tablet_bootstrap.cc:492] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.791684 27612 ts_tablet_manager.cc:1367] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240501 08:11:38.792326 27612 raft_consensus.cc:348] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.792526 27612 raft_consensus.cc:374] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.792654 27612 raft_consensus.cc:729] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.792887 27612 consensus_queue.cc:260] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.793678 27612 ts_tablet_manager.cc:1398] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.794023 27612 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.794168 27613 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.794342 27613 ts_tablet_manager.cc:1367] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.169s user 0.025s sys 0.097s
I20240501 08:11:38.794358 27321 catalog_manager.cc:5484] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.795338 27613 raft_consensus.cc:348] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.795583 27613 raft_consensus.cc:374] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.795706 27613 raft_consensus.cc:729] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.795140 27321 catalog_manager.cc:5484] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.796083 27612 tablet_bootstrap.cc:654] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.795996 27613 consensus_queue.cc:260] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.796336 27321 catalog_manager.cc:5484] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.797674 27623 ts_tablet_manager.cc:1398] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20240501 08:11:38.798034 27623 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.796736 27613 ts_tablet_manager.cc:1398] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:38.798864 27613 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.800750 27612 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.800809 27613 tablet_bootstrap.cc:654] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.800916 27612 ts_tablet_manager.cc:1367] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20240501 08:11:38.801637 27612 raft_consensus.cc:348] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.801867 27612 raft_consensus.cc:374] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.801942 27612 raft_consensus.cc:729] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.802217 27612 consensus_queue.cc:260] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.804589 27642 raft_consensus.cc:482] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.804755 27642 raft_consensus.cc:504] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.805367 27642 leader_election.cc:288] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.805807 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.806113 27570 raft_consensus.cc:2379] T 18d08b926bac4fc5aac71cf5d27404f3 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:38.806746 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18d08b926bac4fc5aac71cf5d27404f3" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.807380 27463 leader_election.cc:302] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.807816 27613 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.807960 27642 raft_consensus.cc:3037] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.808404 27613 ts_tablet_manager.cc:1367] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20240501 08:11:38.810058 27612 ts_tablet_manager.cc:1398] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 08:11:38.810458 27612 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.810591 27613 raft_consensus.cc:348] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.810868 27613 raft_consensus.cc:374] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.811014 27613 raft_consensus.cc:729] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.812780 27642 raft_consensus.cc:2726] T 18d08b926bac4fc5aac71cf5d27404f3 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.812860 27613 consensus_queue.cc:260] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.813344 27319 catalog_manager.cc:5484] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.818120 27613 ts_tablet_manager.cc:1398] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20240501 08:11:38.820866 27612 tablet_bootstrap.cc:654] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.822217 27613 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.822983 27623 tablet_bootstrap.cc:654] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.823884 27613 tablet_bootstrap.cc:654] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.830796 27623 tablet_bootstrap.cc:492] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.831157 27623 ts_tablet_manager.cc:1367] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.009s
I20240501 08:11:38.832504 27623 raft_consensus.cc:348] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.832808 27623 raft_consensus.cc:374] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.832994 27623 raft_consensus.cc:729] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.833331 27623 consensus_queue.cc:260] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.836982 27612 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.837033 27613 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.837270 27613 ts_tablet_manager.cc:1367] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.000s
I20240501 08:11:38.837299 27612 ts_tablet_manager.cc:1367] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.004s
I20240501 08:11:38.837699 27623 ts_tablet_manager.cc:1398] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:38.838069 27613 raft_consensus.cc:348] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.838286 27613 raft_consensus.cc:374] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.838392 27613 raft_consensus.cc:729] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.838663 27613 consensus_queue.cc:260] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.838615 27612 raft_consensus.cc:348] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.839023 27612 raft_consensus.cc:374] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.839175 27612 raft_consensus.cc:729] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.839504 27612 consensus_queue.cc:260] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.841099 27613 ts_tablet_manager.cc:1398] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240501 08:11:38.841472 27613 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.842065 27624 raft_consensus.cc:482] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.842227 27624 raft_consensus.cc:504] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.842919 27624 leader_election.cc:288] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.843467 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c134f2aacd4ec0b28877d654a63634" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.843598 27623 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.844336 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c134f2aacd4ec0b28877d654a63634" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.844568 27567 raft_consensus.cc:2454] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.845041 27612 ts_tablet_manager.cc:1398] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20240501 08:11:38.845152 27389 leader_election.cc:341] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.845618 27387 leader_election.cc:302] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.846079 27624 raft_consensus.cc:2781] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.846181 27624 raft_consensus.cc:482] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.846313 27624 raft_consensus.cc:3037] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.847576 27623 tablet_bootstrap.cc:654] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.848740 27804 raft_consensus.cc:482] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.848906 27804 raft_consensus.cc:504] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.849617 27804 leader_election.cc:288] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.849962 27612 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.850205 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d391d2e046644170902ab1c13b99bc20" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.850304 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d391d2e046644170902ab1c13b99bc20" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.850431 27423 raft_consensus.cc:2454] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.850826 27537 leader_election.cc:302] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
W20240501 08:11:38.851189 27538 leader_election.cc:341] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.851536 27804 raft_consensus.cc:2781] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.851661 27804 raft_consensus.cc:482] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.851776 27804 raft_consensus.cc:3037] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.852622 27612 tablet_bootstrap.cc:654] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.852825 27624 raft_consensus.cc:504] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.853833 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c134f2aacd4ec0b28877d654a63634" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.854033 27567 raft_consensus.cc:3037] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.854506 27804 raft_consensus.cc:504] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.855954 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44c134f2aacd4ec0b28877d654a63634" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.856282 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d391d2e046644170902ab1c13b99bc20" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.856564 27675 raft_consensus.cc:482] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.856673 27675 raft_consensus.cc:504] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.857151 27675 leader_election.cc:288] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.857827 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.857980 27497 raft_consensus.cc:2454] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
W20240501 08:11:38.858235 27389 leader_election.cc:341] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:38.858453 27538 leader_election.cc:341] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.858752 27389 leader_election.cc:302] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.859133 27675 raft_consensus.cc:2781] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.859220 27675 raft_consensus.cc:482] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.859381 27675 raft_consensus.cc:3037] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.859508 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.859651 27570 raft_consensus.cc:2454] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.860044 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d391d2e046644170902ab1c13b99bc20" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.860193 27423 raft_consensus.cc:3037] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.861840 27624 leader_election.cc:288] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.862618 27423 raft_consensus.cc:2454] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.862867 27675 raft_consensus.cc:504] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.863233 27537 leader_election.cc:302] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.863620 27651 raft_consensus.cc:2781] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.863731 27651 raft_consensus.cc:686] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:38.863950 27651 consensus_queue.cc:237] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.864228 27613 tablet_bootstrap.cc:654] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.864333 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.864523 27497 raft_consensus.cc:3037] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.865744 27624 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.866866 27809 raft_consensus.cc:482] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.867009 27809 raft_consensus.cc:504] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.867810 27809 leader_election.cc:288] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.868391 27497 raft_consensus.cc:2454] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.868888 27389 leader_election.cc:302] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.869004 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.869220 27498 raft_consensus.cc:2454] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.869302 27624 raft_consensus.cc:2781] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.869819 27538 leader_election.cc:302] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.869885 27624 raft_consensus.cc:686] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.870127 27809 raft_consensus.cc:2781] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.870213 27809 raft_consensus.cc:482] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.870280 27676 raft_consensus.cc:482] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.870400 27676 raft_consensus.cc:504] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.871053 27676 leader_election.cc:288] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.870290 27809 raft_consensus.cc:3037] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.871944 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.872402 27389 leader_election.cc:341] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.872772 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.873208 27387 leader_election.cc:341] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.873294 27387 leader_election.cc:302] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.873618 27676 raft_consensus.cc:2726] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.873849 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.873977 27423 raft_consensus.cc:2454] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.866997 27804 leader_election.cc:288] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.875206 27809 raft_consensus.cc:504] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.877148 27809 leader_election.cc:288] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.876295 27568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e87b258f8974e47a9ce6295482b0538" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.877601 27568 raft_consensus.cc:3037] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.877924 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.878051 27498 raft_consensus.cc:3037] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.879554 27567 raft_consensus.cc:2454] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.880780 27498 raft_consensus.cc:2454] T ae61fd4c429647b5930c7b71766a94e2 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.881165 27568 raft_consensus.cc:2454] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.875597 27624 consensus_queue.cc:237] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.881191 27709 raft_consensus.cc:482] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.881232 27652 raft_consensus.cc:482] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.881644 27538 leader_election.cc:302] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.881582 27652 raft_consensus.cc:504] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.882174 27652 leader_election.cc:288] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.882215 27387 leader_election.cc:302] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.877455 27675 leader_election.cc:288] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.881580 27709 raft_consensus.cc:504] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.882468 27652 raft_consensus.cc:2781] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.882565 27652 raft_consensus.cc:686] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.882822 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae61fd4c429647b5930c7b71766a94e2" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.882797 27652 consensus_queue.cc:237] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.882916 27709 leader_election.cc:288] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.882958 27423 raft_consensus.cc:3037] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.883947 27809 raft_consensus.cc:2781] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.884215 27809 raft_consensus.cc:686] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:38.884435 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.884532 27809 consensus_queue.cc:237] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:38.884876 27389 leader_election.cc:341] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.884711 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:38.885725 27389 leader_election.cc:341] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.885823 27423 raft_consensus.cc:2454] T ae61fd4c429647b5930c7b71766a94e2 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.858724 27612 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.886106 27612 ts_tablet_manager.cc:1367] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.004s
I20240501 08:11:38.887434 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
W20240501 08:11:38.887894 27387 leader_election.cc:341] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.887996 27387 leader_election.cc:302] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.888432 27709 raft_consensus.cc:2726] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.888985 27676 consensus_queue.cc:1035] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.889689 27613 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.889827 27613 ts_tablet_manager.cc:1367] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.001s
I20240501 08:11:38.890667 27613 raft_consensus.cc:348] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.890861 27613 raft_consensus.cc:374] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.890918 27613 raft_consensus.cc:729] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.891177 27613 consensus_queue.cc:260] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.891989 27613 ts_tablet_manager.cc:1398] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.892421 27613 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.894344 27613 tablet_bootstrap.cc:654] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.895313 27623 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.896356 27623 ts_tablet_manager.cc:1367] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.004s
I20240501 08:11:38.887329 27612 raft_consensus.cc:348] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.896924 27612 raft_consensus.cc:374] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.897044 27612 raft_consensus.cc:729] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.897315 27612 consensus_queue.cc:260] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.899861 27623 raft_consensus.cc:348] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.900058 27623 raft_consensus.cc:374] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.900130 27623 raft_consensus.cc:729] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.901403 27612 ts_tablet_manager.cc:1398] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240501 08:11:38.901805 27612 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.902176 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.902894 27567 raft_consensus.cc:2454] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:38.903350 27387 leader_election.cc:302] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.903805 27675 raft_consensus.cc:2781] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.903944 27675 raft_consensus.cc:482] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.904076 27675 raft_consensus.cc:3037] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.904233 27613 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.904150 27623 consensus_queue.cc:260] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.904363 27613 ts_tablet_manager.cc:1367] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20240501 08:11:38.905109 27613 raft_consensus.cc:348] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.905298 27613 raft_consensus.cc:374] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.905364 27613 raft_consensus.cc:729] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.905550 27613 consensus_queue.cc:260] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.908041 27642 consensus_queue.cc:1035] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.908198 27675 raft_consensus.cc:504] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.908035 27613 ts_tablet_manager.cc:1398] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240501 08:11:38.909211 27613 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.909770 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:38.910409 27389 leader_election.cc:341] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:38.911006 27613 tablet_bootstrap.cc:654] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.912467 27321 catalog_manager.cc:5484] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.916132 27675 leader_election.cc:288] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.919128 27613 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
I20240501 08:11:38.919274 27613 ts_tablet_manager.cc:1367] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240501 08:11:38.919675 27612 tablet_bootstrap.cc:654] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.920296 27613 raft_consensus.cc:348] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.920495 27613 raft_consensus.cc:374] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.920550 27613 raft_consensus.cc:729] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.920727 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.920766 27613 consensus_queue.cc:260] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.920881 27567 raft_consensus.cc:3037] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.921245 27613 ts_tablet_manager.cc:1398] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:38.921499 27613 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93: Bootstrap starting.
I20240501 08:11:38.923400 27613 tablet_bootstrap.cc:654] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.924867 27642 raft_consensus.cc:482] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.925041 27642 raft_consensus.cc:504] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.925881 27642 leader_election.cc:288] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.926635 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32c2c9a4cc824e1cacc1cf572f08b1a7" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.926869 27422 raft_consensus.cc:2454] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.927408 27463 leader_election.cc:302] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.908365 27623 ts_tablet_manager.cc:1398] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20240501 08:11:38.928045 27642 raft_consensus.cc:2781] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.928139 27642 raft_consensus.cc:482] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.928216 27642 raft_consensus.cc:3037] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.931697 27642 raft_consensus.cc:504] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.933043 27422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32c2c9a4cc824e1cacc1cf572f08b1a7" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.933292 27422 raft_consensus.cc:3037] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.934012 27319 catalog_manager.cc:5484] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.936070 27642 leader_election.cc:288] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.936429 27811 raft_consensus.cc:482] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.936563 27811 raft_consensus.cc:504] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.937101 27811 leader_election.cc:288] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:38.938139 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.940234 27612 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.940394 27612 ts_tablet_manager.cc:1367] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20240501 08:11:38.940914 27319 catalog_manager.cc:5484] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:38.946465 27422 raft_consensus.cc:2454] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.946976 27463 leader_election.cc:302] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:38.941157 27612 raft_consensus.cc:348] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.947299 27811 raft_consensus.cc:2781] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.947377 27612 raft_consensus.cc:374] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.947423 27811 raft_consensus.cc:686] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:38.947436 27612 raft_consensus.cc:729] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.947629 27612 consensus_queue.cc:260] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.947669 27811 consensus_queue.cc:237] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.948189 27612 ts_tablet_manager.cc:1398] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20240501 08:11:38.948447 27612 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.928073 27623 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.952500 27612 tablet_bootstrap.cc:654] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.952500 27623 tablet_bootstrap.cc:654] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.954412 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32c2c9a4cc824e1cacc1cf572f08b1a7" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.954638 27569 raft_consensus.cc:2454] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:38.955152 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "32c2c9a4cc824e1cacc1cf572f08b1a7" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:38.955349 27569 raft_consensus.cc:3037] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.956404 27623 tablet_bootstrap.cc:492] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:38.956810 27623 ts_tablet_manager.cc:1367] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.003s
I20240501 08:11:38.957706 27623 raft_consensus.cc:348] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.958168 27569 raft_consensus.cc:2454] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:38.958745 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a751f6bbfc764eac871066bee792832c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:38.960402 27623 raft_consensus.cc:374] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.960498 27623 raft_consensus.cc:729] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.963630 27623 consensus_queue.cc:260] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.960213 27567 raft_consensus.cc:2454] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:38.959129 27809 raft_consensus.cc:482] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.961843 27462 leader_election.cc:302] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:38.963157 27624 consensus_queue.cc:1035] T 18d08b926bac4fc5aac71cf5d27404f3 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.966570 27644 raft_consensus.cc:2726] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:38.967006 27318 catalog_manager.cc:5484] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.970669 27811 consensus_queue.cc:1035] T e121a0b28dc14dec962f98efc3f08137 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.970825 27651 consensus_queue.cc:1035] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:38.971365 27612 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.971503 27612 ts_tablet_manager.cc:1367] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.000s
I20240501 08:11:38.972165 27612 raft_consensus.cc:348] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.972345 27612 raft_consensus.cc:374] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.972409 27612 raft_consensus.cc:729] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.972621 27612 consensus_queue.cc:260] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.973366 27612 ts_tablet_manager.cc:1398] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:38.973706 27612 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.974639 27319 catalog_manager.cc:5484] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:38.975888 27612 tablet_bootstrap.cc:654] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.983914 27612 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:38.984058 27612 ts_tablet_manager.cc:1367] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20240501 08:11:38.985314 27612 raft_consensus.cc:348] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:38.985540 27538 consensus_peers.cc:485] T 739e5b2ab7a64581b57f3e9b0e58e87c P ea3c290047e7442da83cf10d6c197e05 -> Peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Couldn't send request to peer 8547734889f841dbbbff809909a0fc3b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:38.985520 27612 raft_consensus.cc:374] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:38.985687 27612 raft_consensus.cc:729] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:38.985878 27612 consensus_queue.cc:260] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.986392 27612 ts_tablet_manager.cc:1398] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:38.986660 27612 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:38.987185 27809 raft_consensus.cc:504] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.988377 27612 tablet_bootstrap.cc:654] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:38.990095 27809 leader_election.cc:288] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.990453 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:38.991214 27497 raft_consensus.cc:2454] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.992033 27538 leader_election.cc:302] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:38.990517 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:38.992363 27423 raft_consensus.cc:2454] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:38.992715 27809 raft_consensus.cc:2781] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:38.992798 27809 raft_consensus.cc:482] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:38.992872 27809 raft_consensus.cc:3037] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.993964 27387 leader_election.cc:302] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:38.994311 27623 ts_tablet_manager.cc:1398] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.037s user 0.001s sys 0.001s
I20240501 08:11:38.994408 27624 raft_consensus.cc:2781] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:38.994635 27624 raft_consensus.cc:686] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:38.994976 27623 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:38.994948 27624 consensus_queue.cc:237] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.995925 27809 raft_consensus.cc:504] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.996815 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:38.996908 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d3e2c9d80984b2bacd3b622142ff06f" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:38.997038 27497 raft_consensus.cc:3037] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.997061 27423 raft_consensus.cc:3037] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:38.999039 27804 raft_consensus.cc:482] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:38.999178 27804 raft_consensus.cc:504] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:38.999657 27497 raft_consensus.cc:2454] T 5d3e2c9d80984b2bacd3b622142ff06f P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.999697 27423 raft_consensus.cc:2454] T 5d3e2c9d80984b2bacd3b622142ff06f P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:38.999938 27804 leader_election.cc:288] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:38.999996 27538 leader_election.cc:302] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.000229 27804 raft_consensus.cc:2781] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.000362 27804 raft_consensus.cc:686] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.000506 27809 leader_election.cc:288] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.000533 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f7cfadebf624d81b6e1f5ded8397a19" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.000675 27804 consensus_queue.cc:237] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
W20240501 08:11:39.001016 27538 leader_election.cc:341] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.001677 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f7cfadebf624d81b6e1f5ded8397a19" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.002110 27423 raft_consensus.cc:2454] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.002610 27537 leader_election.cc:302] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.002957 27804 raft_consensus.cc:2781] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.003072 27804 raft_consensus.cc:482] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.003165 27804 raft_consensus.cc:3037] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.004880 27623 tablet_bootstrap.cc:654] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.008586 27612 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:39.009791 27612 ts_tablet_manager.cc:1367] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20240501 08:11:39.010991 27612 raft_consensus.cc:348] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.011345 27612 raft_consensus.cc:374] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.011447 27612 raft_consensus.cc:729] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.011844 27612 consensus_queue.cc:260] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.012696 27612 ts_tablet_manager.cc:1398] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:39.013285 27612 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:39.013404 27624 raft_consensus.cc:482] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.007230 27804 raft_consensus.cc:504] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.014420 27624 raft_consensus.cc:504] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.015061 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f7cfadebf624d81b6e1f5ded8397a19" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.018604 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.019066 27709 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.020046 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.020081 27624 leader_election.cc:288] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.020184 27318 catalog_manager.cc:5484] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
W20240501 08:11:39.021728 27538 leader_election.cc:341] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.021874 27804 leader_election.cc:288] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.024088 27613 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93: No bootstrap required, opened a new log
W20240501 08:11:39.024515 27389 leader_election.cc:341] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.024607 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f7cfadebf624d81b6e1f5ded8397a19" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.024832 27567 raft_consensus.cc:2454] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 0.
I20240501 08:11:39.024883 27423 raft_consensus.cc:3037] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.024996 27613 ts_tablet_manager.cc:1367] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93: Time spent bootstrapping tablet: real 0.103s user 0.027s sys 0.033s
I20240501 08:11:39.025713 27613 raft_consensus.cc:348] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.025903 27613 raft_consensus.cc:374] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.025995 27613 raft_consensus.cc:729] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.026257 27613 consensus_queue.cc:260] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.026854 27613 ts_tablet_manager.cc:1398] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:39.027760 27423 raft_consensus.cc:2454] T 1f7cfadebf624d81b6e1f5ded8397a19 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.028702 27612 tablet_bootstrap.cc:654] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.032229 27537 leader_election.cc:302] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.034478 27387 leader_election.cc:302] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.041251 27709 raft_consensus.cc:2781] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.041258 27921 raft_consensus.cc:2781] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.041675 27709 raft_consensus.cc:482] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.041718 27921 raft_consensus.cc:686] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.041682 27624 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20240501 08:11:39.042174 27709 raft_consensus.cc:3037] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.043942 27921 consensus_queue.cc:237] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.045522 27623 tablet_bootstrap.cc:492] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.049726 27709 raft_consensus.cc:504] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.050323 27612 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:39.050779 27612 ts_tablet_manager.cc:1367] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.009s
I20240501 08:11:39.050508 27318 catalog_manager.cc:5484] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.051913 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.052384 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
W20240501 08:11:39.052539 27389 leader_election.cc:341] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.052585 27570 raft_consensus.cc:3037] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.052747 27623 ts_tablet_manager.cc:1367] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.023s
I20240501 08:11:39.053705 27623 raft_consensus.cc:348] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.054029 27623 raft_consensus.cc:374] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.054165 27623 raft_consensus.cc:729] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.054561 27623 consensus_queue.cc:260] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.055101 27642 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.055227 27623 ts_tablet_manager.cc:1398] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:39.055693 27623 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.056159 27570 raft_consensus.cc:2454] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 221d03143b8c485bb23ea0460fd63c93 in term 1.
I20240501 08:11:39.058516 27623 tablet_bootstrap.cc:654] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.059168 27387 leader_election.cc:302] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.059790 27676 raft_consensus.cc:2781] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.059959 27676 raft_consensus.cc:686] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Becoming Leader. State: Replica: 221d03143b8c485bb23ea0460fd63c93, State: Running, Role: LEADER
I20240501 08:11:39.060312 27676 consensus_queue.cc:237] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.062119 27709 leader_election.cc:288] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 election: Requested vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.062073 27612 raft_consensus.cc:348] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.062294 27612 raft_consensus.cc:374] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.062390 27612 raft_consensus.cc:729] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.062603 27612 consensus_queue.cc:260] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.063107 27612 ts_tablet_manager.cc:1398] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20240501 08:11:39.063418 27612 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:39.065151 27612 tablet_bootstrap.cc:654] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.064965 27319 catalog_manager.cc:5484] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.070297 27804 raft_consensus.cc:482] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.070501 27804 raft_consensus.cc:504] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.071306 27804 leader_election.cc:288] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.071528 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "758428df9488427c92435892def3d4fe" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.071771 27423 raft_consensus.cc:2454] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.072000 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "758428df9488427c92435892def3d4fe" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.072218 27537 leader_election.cc:302] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.072561 27804 raft_consensus.cc:2781] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20240501 08:11:39.072561 27538 leader_election.cc:341] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.072688 27804 raft_consensus.cc:482] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.082691 27809 consensus_queue.cc:1035] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.084380 27921 raft_consensus.cc:482] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.095530 27804 raft_consensus.cc:3037] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.098901 27652 raft_consensus.cc:482] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.099076 27921 raft_consensus.cc:504] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.100528 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.102445 27652 raft_consensus.cc:504] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.103366 27652 leader_election.cc:288] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.103586 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.104722 27421 raft_consensus.cc:2454] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
W20240501 08:11:39.106026 27538 leader_election.cc:341] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.106634 27570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.112191 27921 leader_election.cc:288] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.115528 27804 raft_consensus.cc:504] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.117312 27537 leader_election.cc:302] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.116998 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "758428df9488427c92435892def3d4fe" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.118619 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "221d03143b8c485bb23ea0460fd63c93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.120532 27804 leader_election.cc:288] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.120709 27921 raft_consensus.cc:2781] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.120822 27921 raft_consensus.cc:482] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.120936 27921 raft_consensus.cc:3037] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.123736 27921 raft_consensus.cc:504] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.123993 27804 raft_consensus.cc:482] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.124219 27804 raft_consensus.cc:504] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.124390 27921 leader_election.cc:288] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
W20240501 08:11:39.125178 27538 leader_election.cc:341] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
W20240501 08:11:39.125352 27387 leader_election.cc:341] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.124763 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.126744 27612 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:39.126888 27419 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.127300 27419 raft_consensus.cc:2454] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.125690 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "758428df9488427c92435892def3d4fe" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.131335 27420 raft_consensus.cc:3037] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.133074 27804 leader_election.cc:288] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.133986 27612 ts_tablet_manager.cc:1367] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.064s user 0.025s sys 0.016s
I20240501 08:11:39.134045 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.134282 27497 raft_consensus.cc:2454] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.133994 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:39.134815 27389 leader_election.cc:341] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.134754 27612 raft_consensus.cc:348] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.134660 27318 catalog_manager.cc:5484] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129). New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:39.134986 27612 raft_consensus.cc:374] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.135059 27612 raft_consensus.cc:729] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.135128 27389 leader_election.cc:302] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93; no voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.135221 27612 consensus_queue.cc:260] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.135788 27652 raft_consensus.cc:2726] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.135790 27612 ts_tablet_manager.cc:1398] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:39.136451 27612 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05: Bootstrap starting.
I20240501 08:11:39.138092 27612 tablet_bootstrap.cc:654] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.141932 27612 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05: No bootstrap required, opened a new log
I20240501 08:11:39.142104 27612 ts_tablet_manager.cc:1367] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240501 08:11:39.142184 27421 raft_consensus.cc:3037] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.142953 27612 raft_consensus.cc:348] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.143221 27612 raft_consensus.cc:374] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.143357 27612 raft_consensus.cc:729] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.143687 27537 leader_election.cc:302] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.143596 27612 consensus_queue.cc:260] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.143923 27811 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20240501 08:11:39.143956 27420 raft_consensus.cc:2454] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.144829 27537 leader_election.cc:302] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.144934 27421 raft_consensus.cc:2454] T 758428df9488427c92435892def3d4fe P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
W20240501 08:11:39.144992 27538 leader_election.cc:341] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.145247 27537 leader_election.cc:302] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.145303 27623 tablet_bootstrap.cc:492] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.145447 27623 ts_tablet_manager.cc:1367] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.090s user 0.030s sys 0.026s
I20240501 08:11:39.145574 27803 raft_consensus.cc:2781] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.145735 27803 raft_consensus.cc:482] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.145828 27803 raft_consensus.cc:3037] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.146211 27804 raft_consensus.cc:2781] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.146332 27804 raft_consensus.cc:686] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.146574 27804 consensus_queue.cc:237] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.146739 27923 raft_consensus.cc:2781] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.146891 27923 raft_consensus.cc:686] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.147205 27923 consensus_queue.cc:237] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.147388 27623 raft_consensus.cc:348] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.149714 27651 consensus_queue.cc:1035] T 6ca8b6207ad64e53afc74b488e8eea32 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.152062 27894 consensus_queue.cc:1035] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 08:11:39.152603 27803 raft_consensus.cc:504] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.153331 27803 leader_election.cc:288] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.161497 27623 raft_consensus.cc:374] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.162340 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.162673 27497 raft_consensus.cc:3037] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.165340 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cada09f967514de596b2d1e25598729e" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.166162 27612 ts_tablet_manager.cc:1398] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20240501 08:11:39.166600 27420 raft_consensus.cc:3037] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.170707 27420 raft_consensus.cc:2454] T cada09f967514de596b2d1e25598729e P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.171131 27623 raft_consensus.cc:729] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.171626 27623 consensus_queue.cc:260] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.171758 27537 leader_election.cc:302] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.172173 27921 raft_consensus.cc:2781] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.175135 27921 raft_consensus.cc:686] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.175559 27921 consensus_queue.cc:237] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.180315 27497 raft_consensus.cc:2454] T cada09f967514de596b2d1e25598729e P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.182255 27623 ts_tablet_manager.cc:1398] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20240501 08:11:39.182612 27623 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.184470 27623 tablet_bootstrap.cc:654] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.186534 27623 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.186807 27623 ts_tablet_manager.cc:1367] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240501 08:11:39.187726 27623 raft_consensus.cc:348] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.188326 27623 raft_consensus.cc:374] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.188448 27623 raft_consensus.cc:729] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.188799 27623 consensus_queue.cc:260] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.187932 27893 consensus_queue.cc:1035] T 4fb611f9eafc4e109c6d0989d6c409e9 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.188787 27319 catalog_manager.cc:5484] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.189512 27319 catalog_manager.cc:5484] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.189747 27623 ts_tablet_manager.cc:1398] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240501 08:11:39.190603 27623 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.195863 27623 tablet_bootstrap.cc:654] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.198370 27321 catalog_manager.cc:5484] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.207958 27623 tablet_bootstrap.cc:492] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.208146 27623 ts_tablet_manager.cc:1367] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.007s
I20240501 08:11:39.208838 27623 raft_consensus.cc:348] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.209090 27623 raft_consensus.cc:374] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.209203 27623 raft_consensus.cc:729] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.209429 27623 consensus_queue.cc:260] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.210086 27623 ts_tablet_manager.cc:1398] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:39.210407 27623 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.211618 27644 consensus_queue.cc:1035] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.218446 27811 consensus_queue.cc:1035] T b8aff03771b047a991c020cc628aa057 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240501 08:11:39.219327 27623 tablet_bootstrap.cc:654] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.224375 27811 raft_consensus.cc:482] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.224578 27811 raft_consensus.cc:504] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.225425 27811 leader_election.cc:288] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.226467 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.226492 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.226701 27569 raft_consensus.cc:2454] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:39.226747 27420 raft_consensus.cc:2454] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 0.
I20240501 08:11:39.227191 27463 leader_election.cc:302] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:39.228032 27811 raft_consensus.cc:2781] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.228149 27811 raft_consensus.cc:482] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.228231 27811 raft_consensus.cc:3037] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.231426 27811 raft_consensus.cc:504] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.232460 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.232663 27420 raft_consensus.cc:3037] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.235971 27420 raft_consensus.cc:2454] T cf58f5006691429cbd87172f4398e9c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:39.236414 27463 leader_election.cc:302] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, 8547734889f841dbbbff809909a0fc3b; no voters:
I20240501 08:11:39.236778 27894 raft_consensus.cc:2781] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.236951 27894 raft_consensus.cc:686] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Becoming Leader. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Running, Role: LEADER
I20240501 08:11:39.237278 27894 consensus_queue.cc:237] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.241458 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf58f5006691429cbd87172f4398e9c8" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05"
I20240501 08:11:39.241712 27569 raft_consensus.cc:3037] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.241458 27811 leader_election.cc:288] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.247104 27804 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.250110 27811 consensus_queue.cc:1035] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240501 08:11:39.251945 27569 raft_consensus.cc:2454] T cf58f5006691429cbd87172f4398e9c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8547734889f841dbbbff809909a0fc3b in term 1.
I20240501 08:11:39.252817 27623 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.253084 27623 ts_tablet_manager.cc:1367] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.043s user 0.014s sys 0.018s
I20240501 08:11:39.253863 27623 raft_consensus.cc:348] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.254236 27623 raft_consensus.cc:374] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.254354 27623 raft_consensus.cc:729] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.254748 27623 consensus_queue.cc:260] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.256574 27497 raft_consensus.cc:3037] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.258869 27318 catalog_manager.cc:5484] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 8547734889f841dbbbff809909a0fc3b (127.25.181.130). New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:39.259179 27623 ts_tablet_manager.cc:1398] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:39.259588 27623 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.268564 27623 tablet_bootstrap.cc:654] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.275104 27644 consensus_queue.cc:1035] T c6b91c6bda24445c8a0ec60f77733af6 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.281651 27623 tablet_bootstrap.cc:492] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.281832 27623 ts_tablet_manager.cc:1367] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.005s
I20240501 08:11:39.282665 27623 raft_consensus.cc:348] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.282929 27623 raft_consensus.cc:374] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.282991 27623 raft_consensus.cc:729] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.283246 27623 consensus_queue.cc:260] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.283834 27623 ts_tablet_manager.cc:1398] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:39.284116 27623 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.285908 27623 tablet_bootstrap.cc:654] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.288715 27623 tablet_bootstrap.cc:492] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.288839 27623 ts_tablet_manager.cc:1367] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240501 08:11:39.288786 27921 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.289583 27623 raft_consensus.cc:348] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.289796 27623 raft_consensus.cc:374] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.289855 27623 raft_consensus.cc:729] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.290055 27623 consensus_queue.cc:260] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.290812 27623 ts_tablet_manager.cc:1398] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240501 08:11:39.291119 27623 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.293140 27623 tablet_bootstrap.cc:654] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.294981 27893 raft_consensus.cc:482] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.295121 27893 raft_consensus.cc:504] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.295899 27893 leader_election.cc:288] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.296469 27623 tablet_bootstrap.cc:492] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.296523 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.296610 27623 ts_tablet_manager.cc:1367] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20240501 08:11:39.296733 27567 raft_consensus.cc:2379] T beef83ab3d784309ab81be0edf2cc501 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:39.297410 27623 raft_consensus.cc:348] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.297641 27623 raft_consensus.cc:374] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.297972 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beef83ab3d784309ab81be0edf2cc501" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.298377 27921 consensus_queue.cc:1035] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.299101 27463 leader_election.cc:302] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.299634 27893 raft_consensus.cc:3037] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.304905 27498 raft_consensus.cc:3037] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.305022 27623 raft_consensus.cc:729] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.305305 27623 consensus_queue.cc:260] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.306017 27623 ts_tablet_manager.cc:1398] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240501 08:11:39.306335 27623 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.309142 27893 raft_consensus.cc:2726] T beef83ab3d784309ab81be0edf2cc501 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.311172 27623 tablet_bootstrap.cc:654] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.319244 27623 tablet_bootstrap.cc:492] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.319470 27623 ts_tablet_manager.cc:1367] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20240501 08:11:39.320209 27623 raft_consensus.cc:348] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.320441 27623 raft_consensus.cc:374] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.320518 27623 raft_consensus.cc:729] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.320740 27623 consensus_queue.cc:260] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.321166 27493 raft_consensus.cc:3037] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.325516 27652 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.326241 27623 ts_tablet_manager.cc:1398] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240501 08:11:39.326586 27623 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.328003 27921 raft_consensus.cc:482] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.328162 27921 raft_consensus.cc:504] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.328887 27921 leader_election.cc:288] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.329037 27921 consensus_queue.cc:1035] T ae61fd4c429647b5930c7b71766a94e2 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.329887 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.330133 27420 raft_consensus.cc:2454] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.330719 27537 leader_election.cc:302] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.331257 27923 raft_consensus.cc:2781] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.331377 27923 raft_consensus.cc:482] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.331452 27923 raft_consensus.cc:3037] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.331926 27493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
W20240501 08:11:39.332520 27538 leader_election.cc:341] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.334805 27923 raft_consensus.cc:504] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.335793 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.335953 27421 raft_consensus.cc:3037] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.337044 27676 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.338907 27623 tablet_bootstrap.cc:654] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.339190 27421 raft_consensus.cc:2454] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.339609 27537 leader_election.cc:302] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.339884 27893 raft_consensus.cc:482] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.340049 27893 raft_consensus.cc:504] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.340757 27893 leader_election.cc:288] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.339949 27803 raft_consensus.cc:2781] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.339903 27923 leader_election.cc:288] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.341176 27803 raft_consensus.cc:686] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.341485 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.341501 27803 consensus_queue.cc:237] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.341720 27569 raft_consensus.cc:2379] T bac1e15e326d46caa81b84339ab3b9fa P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate 221d03143b8c485bb23ea0460fd63c93 in this term.
I20240501 08:11:39.342422 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.342417 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bac1e15e326d46caa81b84339ab3b9fa" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
W20240501 08:11:39.342952 27538 leader_election.cc:341] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.342958 27463 leader_election.cc:302] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.343765 27652 consensus_queue.cc:1035] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.345276 27644 raft_consensus.cc:3037] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.347826 27804 raft_consensus.cc:482] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.347949 27804 raft_consensus.cc:504] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.348557 27804 leader_election.cc:288] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.348627 27623 tablet_bootstrap.cc:492] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.348748 27623 ts_tablet_manager.cc:1367] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20240501 08:11:39.348798 27644 raft_consensus.cc:2726] T bac1e15e326d46caa81b84339ab3b9fa P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.349171 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.349368 27421 raft_consensus.cc:2454] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.349447 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.349454 27623 raft_consensus.cc:348] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.349735 27623 raft_consensus.cc:374] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.349781 27537 leader_election.cc:302] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.349817 27623 raft_consensus.cc:729] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
W20240501 08:11:39.350000 27538 leader_election.cc:341] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.350031 27804 raft_consensus.cc:2781] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.350523 27804 raft_consensus.cc:482] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.350627 27804 raft_consensus.cc:3037] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.354178 27804 raft_consensus.cc:504] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.356340 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.356542 27421 raft_consensus.cc:3037] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.356487 27497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
W20240501 08:11:39.357111 27538 leader_election.cc:341] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): Illegal state: must be running to vote when last-logged opid is not known
I20240501 08:11:39.357311 27804 leader_election.cc:288] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.350036 27623 consensus_queue.cc:260] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.358207 27623 ts_tablet_manager.cc:1398] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20240501 08:11:39.358538 27421 raft_consensus.cc:2454] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.358588 27623 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.358876 27537 leader_election.cc:302] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters: 8547734889f841dbbbff809909a0fc3b
I20240501 08:11:39.359350 27803 raft_consensus.cc:2781] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.359572 27803 raft_consensus.cc:686] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.359786 27803 consensus_queue.cc:237] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.361122 27623 tablet_bootstrap.cc:654] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.362339 27321 catalog_manager.cc:5484] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.365093 27644 consensus_queue.cc:1035] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.373327 27652 consensus_queue.cc:1035] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.375597 27644 raft_consensus.cc:482] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.375739 27644 raft_consensus.cc:504] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.376505 27644 leader_election.cc:288] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.377494 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.377477 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "739e5b2ab7a64581b57f3e9b0e58e87c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.378538 27463 leader_election.cc:302] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.378948 27644 raft_consensus.cc:2726] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.379973 27623 tablet_bootstrap.cc:492] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.380137 27623 ts_tablet_manager.cc:1367] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.005s
I20240501 08:11:39.380364 27321 catalog_manager.cc:5484] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.380985 27623 raft_consensus.cc:348] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.381225 27623 raft_consensus.cc:374] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.381294 27623 raft_consensus.cc:729] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.381336 27644 raft_consensus.cc:482] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.381444 27644 raft_consensus.cc:504] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.381538 27623 consensus_queue.cc:260] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.382022 27644 leader_election.cc:288] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.382282 27623 ts_tablet_manager.cc:1398] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:39.382594 27623 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b: Bootstrap starting.
I20240501 08:11:39.382913 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.383585 27421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb4b579b3d14e43917e295ee61142a5" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.383775 27421 raft_consensus.cc:2379] T 7fb4b579b3d14e43917e295ee61142a5 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate ea3c290047e7442da83cf10d6c197e05 in this term.
I20240501 08:11:39.384099 27463 leader_election.cc:302] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.384414 27623 tablet_bootstrap.cc:654] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b: Neither blocks nor log segments found. Creating new log.
I20240501 08:11:39.384806 27644 raft_consensus.cc:3037] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.388327 27644 raft_consensus.cc:2726] T 7fb4b579b3d14e43917e295ee61142a5 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.394591 27642 consensus_queue.cc:1035] T 32c2c9a4cc824e1cacc1cf572f08b1a7 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.399231 27623 tablet_bootstrap.cc:492] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b: No bootstrap required, opened a new log
I20240501 08:11:39.399447 27623 ts_tablet_manager.cc:1367] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20240501 08:11:39.400372 27623 raft_consensus.cc:348] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.400616 27623 raft_consensus.cc:374] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240501 08:11:39.400686 27623 raft_consensus.cc:729] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8547734889f841dbbbff809909a0fc3b, State: Initialized, Role: FOLLOWER
I20240501 08:11:39.400916 27623 consensus_queue.cc:260] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.401564 27623 ts_tablet_manager.cc:1398] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240501 08:11:39.486837 27493 raft_consensus.cc:3037] T 1f7cfadebf624d81b6e1f5ded8397a19 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.489935 27804 consensus_queue.cc:1035] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.494885 27921 consensus_queue.cc:1035] T 1f7cfadebf624d81b6e1f5ded8397a19 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.513265 27804 consensus_queue.cc:1035] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.522899 27804 consensus_queue.cc:1035] T 5d3e2c9d80984b2bacd3b622142ff06f P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.529112 27493 raft_consensus.cc:3037] T 739e5b2ab7a64581b57f3e9b0e58e87c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.536553 27642 raft_consensus.cc:482] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.536707 27642 raft_consensus.cc:504] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.537355 27642 leader_election.cc:288] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.537635 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.537909 27420 raft_consensus.cc:2379] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate ea3c290047e7442da83cf10d6c197e05 in this term.
I20240501 08:11:39.537881 27569 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c25f8ef6a0c48d39d96ae18625b7c1c" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.538415 27462 leader_election.cc:302] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.538769 27642 raft_consensus.cc:3037] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.541235 27642 raft_consensus.cc:2726] T 3c25f8ef6a0c48d39d96ae18625b7c1c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.541389 27804 raft_consensus.cc:482] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.541548 27804 raft_consensus.cc:504] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.542484 27804 leader_election.cc:288] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.543093 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b" is_pre_election: true
I20240501 08:11:39.543195 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.543339 27498 raft_consensus.cc:2454] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.543411 27420 raft_consensus.cc:2454] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 0.
I20240501 08:11:39.543821 27537 leader_election.cc:302] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.544322 27804 raft_consensus.cc:2781] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240501 08:11:39.544430 27804 raft_consensus.cc:482] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240501 08:11:39.544508 27804 raft_consensus.cc:3037] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.547966 27804 raft_consensus.cc:504] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.544288 27709 consensus_queue.cc:1035] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.549968 27420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93"
I20240501 08:11:39.550187 27420 raft_consensus.cc:3037] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.554415 27804 leader_election.cc:288] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Requested vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:39.555938 27498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a53c3300b338440eafaf8027a46fb3e3" candidate_uuid: "ea3c290047e7442da83cf10d6c197e05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8547734889f841dbbbff809909a0fc3b"
I20240501 08:11:39.556174 27498 raft_consensus.cc:3037] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.558914 27804 consensus_queue.cc:1035] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.560642 27676 consensus_queue.cc:1035] T bac1e15e326d46caa81b84339ab3b9fa P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.562590 27709 consensus_queue.cc:1035] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.564116 27921 consensus_queue.cc:1035] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.564606 27498 raft_consensus.cc:2454] T a53c3300b338440eafaf8027a46fb3e3 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.565106 27538 leader_election.cc:302] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b, ea3c290047e7442da83cf10d6c197e05; no voters:
I20240501 08:11:39.565634 27651 raft_consensus.cc:2781] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Leader election won for term 1
I20240501 08:11:39.565786 27651 raft_consensus.cc:686] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Becoming Leader. State: Replica: ea3c290047e7442da83cf10d6c197e05, State: Running, Role: LEADER
I20240501 08:11:39.566077 27651 consensus_queue.cc:237] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.572077 27803 consensus_queue.cc:1035] T 7fb4b579b3d14e43917e295ee61142a5 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.576097 27642 raft_consensus.cc:482] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240501 08:11:39.576318 27921 consensus_queue.cc:1035] T cada09f967514de596b2d1e25598729e P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.576282 27642 raft_consensus.cc:504] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } }
I20240501 08:11:39.577126 27642 leader_election.cc:288] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561), ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:39.577844 27423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "221d03143b8c485bb23ea0460fd63c93" is_pre_election: true
I20240501 08:11:39.578191 27423 raft_consensus.cc:2379] T fdc5538831434a728aa68ffc27f288e0 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8547734889f841dbbbff809909a0fc3b in current term 1: Already voted for candidate ea3c290047e7442da83cf10d6c197e05 in this term.
I20240501 08:11:39.581765 27420 raft_consensus.cc:2454] T a53c3300b338440eafaf8027a46fb3e3 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea3c290047e7442da83cf10d6c197e05 in term 1.
I20240501 08:11:39.588481 27567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc5538831434a728aa68ffc27f288e0" candidate_uuid: "8547734889f841dbbbff809909a0fc3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea3c290047e7442da83cf10d6c197e05" is_pre_election: true
I20240501 08:11:39.592223 27319 catalog_manager.cc:5484] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: term changed from 0 to 1, leader changed from <none> to ea3c290047e7442da83cf10d6c197e05 (127.25.181.131). New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } }
I20240501 08:11:39.592628 27462 leader_election.cc:302] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8547734889f841dbbbff809909a0fc3b; no voters: 221d03143b8c485bb23ea0460fd63c93, ea3c290047e7442da83cf10d6c197e05
I20240501 08:11:39.593158 27642 raft_consensus.cc:3037] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.596645 27642 raft_consensus.cc:2726] T fdc5538831434a728aa68ffc27f288e0 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240501 08:11:39.605262 27709 consensus_queue.cc:1035] T beef83ab3d784309ab81be0edf2cc501 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.627662 27498 raft_consensus.cc:3037] T 758428df9488427c92435892def3d4fe P 8547734889f841dbbbff809909a0fc3b [term 0 FOLLOWER]: Advancing to term 1
I20240501 08:11:39.630635 27921 consensus_queue.cc:1035] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.632158 27642 consensus_queue.cc:1035] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.639051 27921 consensus_queue.cc:1035] T 758428df9488427c92435892def3d4fe P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.644515 27894 consensus_queue.cc:1035] T cf58f5006691429cbd87172f4398e9c8 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.722007 27921 consensus_queue.cc:1035] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.729574 27921 consensus_queue.cc:1035] T 3c25f8ef6a0c48d39d96ae18625b7c1c P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.782189 27921 consensus_queue.cc:1035] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.788260 27803 consensus_queue.cc:1035] T fdc5538831434a728aa68ffc27f288e0 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.975833 27651 consensus_queue.cc:1035] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240501 08:11:39.979420 26326 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240501 08:11:39.981227 27803 consensus_queue.cc:1035] T a53c3300b338440eafaf8027a46fb3e3 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240501 08:11:39.984761 28008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:40.001183 28009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240501 08:11:40.002013 28012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240501 08:11:40.003407 26326 server_base.cc:1034] running on GCE node
I20240501 08:11:40.003711 26326 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240501 08:11:40.003820 26326 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240501 08:11:40.003886 26326 hybrid_clock.cc:648] HybridClock initialized: now 1714551100003860 us; error 0 us; skew 500 ppm
I20240501 08:11:40.004104 26326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240501 08:11:40.010679 26326 webserver.cc:460] Webserver started at http://127.25.181.132:37687/ using document root <none> and password file <none>
I20240501 08:11:40.011006 26326 fs_manager.cc:359] Metadata directory not provided
I20240501 08:11:40.011111 26326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240501 08:11:40.011305 26326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240501 08:11:40.012164 26326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-3-root/instance:
uuid: "830dd904c2774512a0ed71d30e63b292"
format_stamp: "Formatted at 2024-05-01 08:11:40 on dist-test-slave-4f6n"
I20240501 08:11:40.015081 26326 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20240501 08:11:40.016932 28017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:40.017273 26326 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:40.017408 26326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-3-root
uuid: "830dd904c2774512a0ed71d30e63b292"
format_stamp: "Formatted at 2024-05-01 08:11:40 on dist-test-slave-4f6n"
I20240501 08:11:40.017546 26326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240501 08:11:40.037618 26326 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240501 08:11:40.038157 26326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240501 08:11:40.038652 26326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240501 08:11:40.039609 26326 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240501 08:11:40.039697 26326 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:40.039775 26326 ts_tablet_manager.cc:590] Registered 0 tablets
I20240501 08:11:40.039830 26326 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240501 08:11:40.065594 26326 rpc_server.cc:307] RPC server started. Bound to: 127.25.181.132:40305
I20240501 08:11:40.065639 28079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.181.132:40305 every 8 connection(s)
I20240501 08:11:40.067421 26326 auto_leader_rebalancer-test.cc:405] add a tserver: 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:40.073191 28080 heartbeater.cc:347] Connected to a master server at 127.25.181.190:37997
I20240501 08:11:40.073338 28080 heartbeater.cc:464] Registering TS with master...
I20240501 08:11:40.073750 28080 heartbeater.cc:511] Master 127.25.181.190:37997 requested a full tablet report, sending...
I20240501 08:11:40.074571 27321 ts_manager.cc:194] Registered new tserver with Master: 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305)
I20240501 08:11:40.075387 27321 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42600
I20240501 08:11:40.718426 27567 consensus_queue.cc:237] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:40.721083 27420 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.721201 27496 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.721833 27651 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.722131 27804 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.728065 27651 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.728734 27496 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
W20240501 08:11:40.730396 27535 consensus_peers.cc:485] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8d4c7a91a1440b1b8c2cb6d749c44f8. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:40.738502 27319 catalog_manager.cc:5484] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:40.741748 27420 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.747471 27421 consensus_queue.cc:237] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:40.752769 27496 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.753466 27676 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.757411 27567 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.758177 27676 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.773824 27676 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.774784 27567 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.774784 27498 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
W20240501 08:11:40.785027 27386 consensus_peers.cc:485] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a751f6bbfc764eac871066bee792832c. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:40.789044 27321 catalog_manager.cc:5484] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.795749 27496 consensus_queue.cc:237] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:40.798435 27421 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.799105 27894 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.804095 27567 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.805265 27894 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.810506 27894 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.811182 27567 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.823562 27421 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
W20240501 08:11:40.825183 27461 consensus_peers.cc:485] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b078e697a866402083f8b9b79695016b. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:40.826956 27319 catalog_manager.cc:5484] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.831614 27421 consensus_queue.cc:237] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
W20240501 08:11:40.835028 27386 consensus_peers.cc:485] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd5ccea69adc48058e2f17dd9901eb8a. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:40.835054 27567 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.835127 27496 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:40.835621 28097 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.835942 27676 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:40.839807 28097 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.840384 27496 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.841508 27570 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:40.845827 27321 catalog_manager.cc:5484] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:41.076498 28080 heartbeater.cc:503] Master 127.25.181.190:37997 was elected leader, sending a full tablet report...
I20240501 08:11:41.239305 28112 ts_tablet_manager.cc:902] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:41.241127 28116 ts_tablet_manager.cc:902] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:41.246608 28116 tablet_copy_client.cc:308] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.130:39237
I20240501 08:11:41.247370 28112 tablet_copy_client.cc:308] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.129:42561
I20240501 08:11:41.255831 27508 tablet_copy_service.cc:140] P 8547734889f841dbbbff809909a0fc3b: Received BeginTabletCopySession request for tablet b078e697a866402083f8b9b79695016b from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:50836)
I20240501 08:11:41.256101 27508 tablet_copy_service.cc:161] P 8547734889f841dbbbff809909a0fc3b: Beginning new tablet copy session on tablet b078e697a866402083f8b9b79695016b from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:50836: session id = 830dd904c2774512a0ed71d30e63b292-b078e697a866402083f8b9b79695016b
I20240501 08:11:41.259220 27433 tablet_copy_service.cc:140] P 221d03143b8c485bb23ea0460fd63c93: Received BeginTabletCopySession request for tablet a751f6bbfc764eac871066bee792832c from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:53928)
I20240501 08:11:41.259442 27433 tablet_copy_service.cc:161] P 221d03143b8c485bb23ea0460fd63c93: Beginning new tablet copy session on tablet a751f6bbfc764eac871066bee792832c from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:53928: session id = 830dd904c2774512a0ed71d30e63b292-a751f6bbfc764eac871066bee792832c
I20240501 08:11:41.260356 27508 tablet_copy_source_session.cc:205] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:41.262423 27433 tablet_copy_source_session.cc:205] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:41.263495 28116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b078e697a866402083f8b9b79695016b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:41.263718 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a751f6bbfc764eac871066bee792832c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:41.269075 28112 tablet_copy_client.cc:783] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:41.269416 28112 tablet_copy_client.cc:647] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:41.270141 28116 tablet_copy_client.cc:783] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:41.270391 28116 tablet_copy_client.cc:647] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:41.272323 28112 tablet_copy_client.cc:523] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:41.272382 28116 tablet_copy_client.cc:523] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:41.276783 28112 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:41.276783 28116 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:41.286832 28116 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:41.286832 28112 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:41.287457 28112 tablet_bootstrap.cc:492] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:41.287465 28116 tablet_bootstrap.cc:492] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:41.287779 28116 ts_tablet_manager.cc:1367] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.007s
I20240501 08:11:41.287776 28112 ts_tablet_manager.cc:1367] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.006s
I20240501 08:11:41.288797 28112 raft_consensus.cc:348] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.288796 28116 raft_consensus.cc:348] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.289122 28112 raft_consensus.cc:729] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:41.289172 28116 raft_consensus.cc:729] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:41.289338 28112 consensus_queue.cc:260] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.289352 28116 consensus_queue.cc:260] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.290534 28116 ts_tablet_manager.cc:1398] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:41.290751 28112 ts_tablet_manager.cc:1398] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240501 08:11:41.291256 27508 tablet_copy_service.cc:342] P 8547734889f841dbbbff809909a0fc3b: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-b078e697a866402083f8b9b79695016b received from {username='slave'} at 127.0.0.1:50836
I20240501 08:11:41.291421 27508 tablet_copy_service.cc:433] P 8547734889f841dbbbff809909a0fc3b: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-b078e697a866402083f8b9b79695016b on tablet b078e697a866402083f8b9b79695016b with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:41.291862 27433 tablet_copy_service.cc:342] P 221d03143b8c485bb23ea0460fd63c93: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-a751f6bbfc764eac871066bee792832c received from {username='slave'} at 127.0.0.1:53928
I20240501 08:11:41.291968 27433 tablet_copy_service.cc:433] P 221d03143b8c485bb23ea0460fd63c93: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-a751f6bbfc764eac871066bee792832c on tablet a751f6bbfc764eac871066bee792832c with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:41.334998 28112 ts_tablet_manager.cc:902] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:41.336390 28112 tablet_copy_client.cc:308] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.131:39407
I20240501 08:11:41.343612 27582 tablet_copy_service.cc:140] P ea3c290047e7442da83cf10d6c197e05: Received BeginTabletCopySession request for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:36962)
I20240501 08:11:41.343818 27582 tablet_copy_service.cc:161] P ea3c290047e7442da83cf10d6c197e05: Beginning new tablet copy session on tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:36962: session id = 830dd904c2774512a0ed71d30e63b292-b8d4c7a91a1440b1b8c2cb6d749c44f8
I20240501 08:11:41.346283 27582 tablet_copy_source_session.cc:205] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:41.347476 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:41.353129 28112 tablet_copy_client.cc:783] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:41.353365 28112 tablet_copy_client.cc:647] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:41.354856 28112 tablet_copy_client.cc:523] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:41.357868 28112 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:41.364120 28112 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:41.364575 28112 tablet_bootstrap.cc:492] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:41.364868 28112 ts_tablet_manager.cc:1367] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.003s
I20240501 08:11:41.365561 28112 raft_consensus.cc:348] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.365864 28112 raft_consensus.cc:729] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:41.366084 28112 consensus_queue.cc:260] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.367354 28112 ts_tablet_manager.cc:1398] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:41.368031 27582 tablet_copy_service.cc:342] P ea3c290047e7442da83cf10d6c197e05: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-b8d4c7a91a1440b1b8c2cb6d749c44f8 received from {username='slave'} at 127.0.0.1:36962
I20240501 08:11:41.368173 27582 tablet_copy_service.cc:433] P ea3c290047e7442da83cf10d6c197e05: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-b8d4c7a91a1440b1b8c2cb6d749c44f8 on tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:41.372920 28112 ts_tablet_manager.cc:902] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:41.374208 28112 tablet_copy_client.cc:308] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.129:42561
I20240501 08:11:41.374780 27433 tablet_copy_service.cc:140] P 221d03143b8c485bb23ea0460fd63c93: Received BeginTabletCopySession request for tablet cd5ccea69adc48058e2f17dd9901eb8a from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:53928)
I20240501 08:11:41.374902 27433 tablet_copy_service.cc:161] P 221d03143b8c485bb23ea0460fd63c93: Beginning new tablet copy session on tablet cd5ccea69adc48058e2f17dd9901eb8a from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:53928: session id = 830dd904c2774512a0ed71d30e63b292-cd5ccea69adc48058e2f17dd9901eb8a
I20240501 08:11:41.377394 27433 tablet_copy_source_session.cc:205] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:41.378557 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5ccea69adc48058e2f17dd9901eb8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:41.384722 28112 tablet_copy_client.cc:783] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:41.384961 28112 tablet_copy_client.cc:647] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:41.386425 28112 tablet_copy_client.cc:523] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:41.389930 28112 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:41.395659 28112 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:41.395993 28112 tablet_bootstrap.cc:492] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:41.396207 28112 ts_tablet_manager.cc:1367] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.004s
I20240501 08:11:41.396848 28112 raft_consensus.cc:348] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.397019 28112 raft_consensus.cc:729] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:41.397146 28112 consensus_queue.cc:260] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:41.397595 28112 ts_tablet_manager.cc:1398] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240501 08:11:41.398198 27433 tablet_copy_service.cc:342] P 221d03143b8c485bb23ea0460fd63c93: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-cd5ccea69adc48058e2f17dd9901eb8a received from {username='slave'} at 127.0.0.1:53928
I20240501 08:11:41.398324 27433 tablet_copy_service.cc:433] P 221d03143b8c485bb23ea0460fd63c93: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-cd5ccea69adc48058e2f17dd9901eb8a on tablet cd5ccea69adc48058e2f17dd9901eb8a with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:41.716229 28055 raft_consensus.cc:1203] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:41.769294 28055 raft_consensus.cc:1203] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:41.877022 28055 raft_consensus.cc:1203] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:41.910801 28055 raft_consensus.cc:1203] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:42.151437 28097 raft_consensus.cc:1050] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:42.152473 28097 consensus_queue.cc:237] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.155272 28055 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.155323 27498 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.155524 27569 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.155946 27676 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.156510 27676 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.158015 28140 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.168752 28146 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.169507 28055 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.171690 27569 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.173331 27498 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.175505 27318 catalog_manager.cc:5484] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.185195 27423 consensus_queue.cc:237] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.187253 27569 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.187337 28055 raft_consensus.cc:1261] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.187775 28097 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.188045 28146 consensus_queue.cc:1035] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.190847 28146 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.191466 28055 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.192631 27567 raft_consensus.cc:2932] T cd5ccea69adc48058e2f17dd9901eb8a P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.194646 27307 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cd5ccea69adc48058e2f17dd9901eb8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:42.196689 27320 catalog_manager.cc:5484] T cd5ccea69adc48058e2f17dd9901eb8a P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.202037 27482 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5ccea69adc48058e2f17dd9901eb8a with delete_type TABLET_DATA_TOMBSTONED (TS 8547734889f841dbbbff809909a0fc3b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52858
I20240501 08:11:42.211807 28156 tablet_replica.cc:330] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: stopping tablet replica
I20240501 08:11:42.212093 28156 raft_consensus.cc:2229] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:42.212368 28156 raft_consensus.cc:2258] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:42.213275 28156 ts_tablet_manager.cc:1875] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:42.218690 28156 ts_tablet_manager.cc:1888] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:42.218864 28156 log.cc:1196] T cd5ccea69adc48058e2f17dd9901eb8a P 8547734889f841dbbbff809909a0fc3b: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/wals/cd5ccea69adc48058e2f17dd9901eb8a
I20240501 08:11:42.219656 27308 catalog_manager.cc:4830] TS 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): tablet cd5ccea69adc48058e2f17dd9901eb8a (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:42.291770 28097 raft_consensus.cc:1050] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:42.292668 28097 consensus_queue.cc:237] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.295348 27498 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.295647 27569 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.295806 28097 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.296314 28097 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.300753 28055 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.301285 28155 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.301877 28142 raft_consensus.cc:1050] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:42.303015 28142 consensus_queue.cc:237] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.304647 27676 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.305130 28054 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.310864 27569 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.311015 27498 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.312235 27319 catalog_manager.cc:5484] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.314996 28055 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.315507 27570 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.316004 28142 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.316598 27421 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.316612 28141 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.318692 28141 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.322033 28108 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.324790 28054 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.325428 27421 consensus_queue.cc:237] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.327199 27423 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.328032 28055 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.329598 27676 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.330183 27319 catalog_manager.cc:5484] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.331498 27569 raft_consensus.cc:1261] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.332070 27676 consensus_queue.cc:1035] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.333071 28146 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.333745 28055 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.338718 27570 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.339676 27567 raft_consensus.cc:2932] T a751f6bbfc764eac871066bee792832c P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.344149 27307 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a751f6bbfc764eac871066bee792832c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:42.345145 27321 catalog_manager.cc:5484] T a751f6bbfc764eac871066bee792832c P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:42.343853 27498 consensus_queue.cc:237] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.349678 27482 tablet_service.cc:1514] Processing DeleteTablet for tablet a751f6bbfc764eac871066bee792832c with delete_type TABLET_DATA_TOMBSTONED (TS 8547734889f841dbbbff809909a0fc3b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52858
I20240501 08:11:42.350008 28156 tablet_replica.cc:330] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: stopping tablet replica
I20240501 08:11:42.350203 28156 raft_consensus.cc:2229] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:42.350402 28156 raft_consensus.cc:2258] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:42.351444 28156 ts_tablet_manager.cc:1875] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:42.352301 27803 raft_consensus.cc:1050] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:42.353067 27803 consensus_queue.cc:237] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.355500 27423 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.355502 27493 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.355502 28054 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:42.356009 27651 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.356714 27651 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.357182 27651 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:42.362917 28156 ts_tablet_manager.cc:1888] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:42.363047 28156 log.cc:1196] T a751f6bbfc764eac871066bee792832c P 8547734889f841dbbbff809909a0fc3b: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/wals/a751f6bbfc764eac871066bee792832c
I20240501 08:11:42.363865 27308 catalog_manager.cc:4830] TS 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): tablet a751f6bbfc764eac871066bee792832c (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:42.372737 27651 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.373579 27493 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.374368 27423 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.378386 28054 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.379807 27420 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.380156 28055 raft_consensus.cc:1261] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.380882 28108 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.380774 27320 catalog_manager.cc:5484] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:42.385080 28108 consensus_queue.cc:1035] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.385810 28108 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.387815 27567 consensus_queue.cc:237] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:42.389863 27308 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b078e697a866402083f8b9b79695016b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:42.390233 28055 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.390363 27420 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.392488 27318 catalog_manager.cc:5484] T b078e697a866402083f8b9b79695016b P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:42.393890 28166 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.395056 28055 raft_consensus.cc:2932] T b078e697a866402083f8b9b79695016b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.396298 27803 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.396845 28053 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.397679 27555 tablet_service.cc:1514] Processing DeleteTablet for tablet b078e697a866402083f8b9b79695016b with delete_type TABLET_DATA_TOMBSTONED (TS ea3c290047e7442da83cf10d6c197e05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59534
I20240501 08:11:42.401866 27318 catalog_manager.cc:5484] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.403327 27306 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:42.406481 27498 raft_consensus.cc:1261] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:42.406955 27803 consensus_queue.cc:1035] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:42.407618 27410 tablet_service.cc:1514] Processing DeleteTablet for tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 with delete_type TABLET_DATA_TOMBSTONED (TS 221d03143b8c485bb23ea0460fd63c93 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49234
I20240501 08:11:42.407720 28170 tablet_replica.cc:330] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: stopping tablet replica
I20240501 08:11:42.407930 28170 raft_consensus.cc:2229] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:42.408177 28170 raft_consensus.cc:2258] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:42.408258 28171 tablet_replica.cc:330] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: stopping tablet replica
I20240501 08:11:42.408470 28171 raft_consensus.cc:2229] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:42.408772 28171 raft_consensus.cc:2258] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:42.408936 28170 ts_tablet_manager.cc:1875] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:42.409615 28171 ts_tablet_manager.cc:1875] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:42.410828 27498 raft_consensus.cc:2932] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:42.415885 28171 ts_tablet_manager.cc:1888] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:42.416010 28171 log.cc:1196] T b8d4c7a91a1440b1b8c2cb6d749c44f8 P 221d03143b8c485bb23ea0460fd63c93: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/wals/b8d4c7a91a1440b1b8c2cb6d749c44f8
I20240501 08:11:42.416658 28170 ts_tablet_manager.cc:1888] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:42.416785 28170 log.cc:1196] T b078e697a866402083f8b9b79695016b P ea3c290047e7442da83cf10d6c197e05: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/wals/b078e697a866402083f8b9b79695016b
I20240501 08:11:42.416919 27307 catalog_manager.cc:4830] TS 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): tablet b8d4c7a91a1440b1b8c2cb6d749c44f8 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:42.417915 27306 catalog_manager.cc:4830] TS ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): tablet b078e697a866402083f8b9b79695016b (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:43.422114 27570 consensus_queue.cc:237] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.424167 27420 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:43.424422 27535 consensus_peers.cc:485] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6ac20effe8284a15b83bc3fd1a72d8c8. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:43.424706 27498 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:43.424837 27803 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.425140 27651 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.427439 28166 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.428146 27498 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.432633 27319 catalog_manager.cc:5484] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:43.432864 27423 consensus_queue.cc:237] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.433902 27420 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.435509 27493 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:43.436167 28097 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.436837 27570 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:43.437320 28154 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 08:11:43.438139 27386 consensus_peers.cc:485] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86aa978719c344bca120402ae173afdc. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:43.449564 28154 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.450416 27570 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.450985 27493 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.455030 27567 consensus_queue.cc:237] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.456137 27321 catalog_manager.cc:5484] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:43.458339 27423 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:43.459010 27535 consensus_peers.cc:485] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 200c3f11ec194af394c1c130d22a9663. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:43.459059 28166 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.459594 27498 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:43.462985 28166 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.464442 27803 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.464983 27423 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.469825 27318 catalog_manager.cc:5484] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:43.470602 27498 consensus_queue.cc:237] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.473263 27493 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.473881 27423 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:43.474009 27461 consensus_peers.cc:485] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b509576adf3c4e2c817f12d3fac6f72b. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:43.474023 27567 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:43.474329 28142 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.475060 28142 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:43.478474 28142 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.483526 27423 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.486649 27567 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:43.487198 27318 catalog_manager.cc:5484] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:43.846956 28191 ts_tablet_manager.cc:902] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:43.848497 28191 tablet_copy_client.cc:308] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.131:39407
I20240501 08:11:43.849160 27582 tablet_copy_service.cc:140] P ea3c290047e7442da83cf10d6c197e05: Received BeginTabletCopySession request for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:36962)
I20240501 08:11:43.849279 27582 tablet_copy_service.cc:161] P ea3c290047e7442da83cf10d6c197e05: Beginning new tablet copy session on tablet 6ac20effe8284a15b83bc3fd1a72d8c8 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:36962: session id = 830dd904c2774512a0ed71d30e63b292-6ac20effe8284a15b83bc3fd1a72d8c8
I20240501 08:11:43.851750 27582 tablet_copy_source_session.cc:205] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:43.853013 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ac20effe8284a15b83bc3fd1a72d8c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:43.858309 28191 tablet_copy_client.cc:783] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:43.858665 28191 tablet_copy_client.cc:647] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:43.859170 28196 ts_tablet_manager.cc:902] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:43.860805 28191 tablet_copy_client.cc:523] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:43.863674 28191 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:43.867707 28196 tablet_copy_client.cc:308] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.130:39237
I20240501 08:11:43.868412 27508 tablet_copy_service.cc:140] P 8547734889f841dbbbff809909a0fc3b: Received BeginTabletCopySession request for tablet b509576adf3c4e2c817f12d3fac6f72b from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:50836)
I20240501 08:11:43.868542 27508 tablet_copy_service.cc:161] P 8547734889f841dbbbff809909a0fc3b: Beginning new tablet copy session on tablet b509576adf3c4e2c817f12d3fac6f72b from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:50836: session id = 830dd904c2774512a0ed71d30e63b292-b509576adf3c4e2c817f12d3fac6f72b
I20240501 08:11:43.870074 28191 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:43.870441 28191 tablet_bootstrap.cc:492] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:43.870659 28191 ts_tablet_manager.cc:1367] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240501 08:11:43.871101 27508 tablet_copy_source_session.cc:205] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:43.871409 28191 raft_consensus.cc:348] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.871897 28191 raft_consensus.cc:729] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:43.872133 28191 consensus_queue.cc:260] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.872818 28196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b509576adf3c4e2c817f12d3fac6f72b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:43.879997 28196 tablet_copy_client.cc:783] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:43.880239 28196 tablet_copy_client.cc:647] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:43.881587 28191 ts_tablet_manager.cc:1398] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20240501 08:11:43.882373 27582 tablet_copy_service.cc:342] P ea3c290047e7442da83cf10d6c197e05: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-6ac20effe8284a15b83bc3fd1a72d8c8 received from {username='slave'} at 127.0.0.1:36962
I20240501 08:11:43.882567 27582 tablet_copy_service.cc:433] P ea3c290047e7442da83cf10d6c197e05: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-6ac20effe8284a15b83bc3fd1a72d8c8 on tablet 6ac20effe8284a15b83bc3fd1a72d8c8 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:43.884449 28196 tablet_copy_client.cc:523] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:43.886807 28191 ts_tablet_manager.cc:902] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:43.887594 28196 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:43.893352 28191 tablet_copy_client.cc:308] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.129:42561
I20240501 08:11:43.894165 27433 tablet_copy_service.cc:140] P 221d03143b8c485bb23ea0460fd63c93: Received BeginTabletCopySession request for tablet 86aa978719c344bca120402ae173afdc from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:53928)
I20240501 08:11:43.894289 27433 tablet_copy_service.cc:161] P 221d03143b8c485bb23ea0460fd63c93: Beginning new tablet copy session on tablet 86aa978719c344bca120402ae173afdc from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:53928: session id = 830dd904c2774512a0ed71d30e63b292-86aa978719c344bca120402ae173afdc
I20240501 08:11:43.896685 27433 tablet_copy_source_session.cc:205] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:43.897670 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86aa978719c344bca120402ae173afdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:43.900679 28196 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:43.901039 28196 tablet_bootstrap.cc:492] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:43.901288 28196 ts_tablet_manager.cc:1367] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.008s
I20240501 08:11:43.902004 28196 raft_consensus.cc:348] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.902243 28196 raft_consensus.cc:729] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:43.902460 28191 tablet_copy_client.cc:783] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:43.902456 28196 consensus_queue.cc:260] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.902683 28191 tablet_copy_client.cc:647] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:43.903021 28196 ts_tablet_manager.cc:1398] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240501 08:11:43.903683 27508 tablet_copy_service.cc:342] P 8547734889f841dbbbff809909a0fc3b: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-b509576adf3c4e2c817f12d3fac6f72b received from {username='slave'} at 127.0.0.1:50836
I20240501 08:11:43.903815 27508 tablet_copy_service.cc:433] P 8547734889f841dbbbff809909a0fc3b: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-b509576adf3c4e2c817f12d3fac6f72b on tablet b509576adf3c4e2c817f12d3fac6f72b with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:43.905242 28191 tablet_copy_client.cc:523] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:43.908371 28191 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:43.913694 28191 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:43.914309 28191 tablet_bootstrap.cc:492] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:43.914542 28191 ts_tablet_manager.cc:1367] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240501 08:11:43.915184 28191 raft_consensus.cc:348] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.915411 28191 raft_consensus.cc:729] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:43.915585 28191 consensus_queue.cc:260] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.916030 28191 ts_tablet_manager.cc:1398] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240501 08:11:43.916661 27433 tablet_copy_service.cc:342] P 221d03143b8c485bb23ea0460fd63c93: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-86aa978719c344bca120402ae173afdc received from {username='slave'} at 127.0.0.1:53928
I20240501 08:11:43.916767 27433 tablet_copy_service.cc:433] P 221d03143b8c485bb23ea0460fd63c93: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-86aa978719c344bca120402ae173afdc on tablet 86aa978719c344bca120402ae173afdc with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:43.974278 28191 ts_tablet_manager.cc:902] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:43.975543 28191 tablet_copy_client.cc:308] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.131:39407
I20240501 08:11:43.976109 27582 tablet_copy_service.cc:140] P ea3c290047e7442da83cf10d6c197e05: Received BeginTabletCopySession request for tablet 200c3f11ec194af394c1c130d22a9663 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:36962)
I20240501 08:11:43.976253 27582 tablet_copy_service.cc:161] P ea3c290047e7442da83cf10d6c197e05: Beginning new tablet copy session on tablet 200c3f11ec194af394c1c130d22a9663 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:36962: session id = 830dd904c2774512a0ed71d30e63b292-200c3f11ec194af394c1c130d22a9663
I20240501 08:11:43.978590 27582 tablet_copy_source_session.cc:205] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:43.979760 28191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200c3f11ec194af394c1c130d22a9663. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:43.984789 28191 tablet_copy_client.cc:783] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:43.985008 28191 tablet_copy_client.cc:647] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:43.986235 28191 tablet_copy_client.cc:523] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:43.989091 28191 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:43.994338 28191 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:43.994642 28191 tablet_bootstrap.cc:492] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:43.994848 28191 ts_tablet_manager.cc:1367] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.000s
I20240501 08:11:43.995498 28191 raft_consensus.cc:348] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.995726 28191 raft_consensus.cc:729] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:43.995939 28191 consensus_queue.cc:260] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:43.996479 28191 ts_tablet_manager.cc:1398] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:43.997094 27582 tablet_copy_service.cc:342] P ea3c290047e7442da83cf10d6c197e05: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-200c3f11ec194af394c1c130d22a9663 received from {username='slave'} at 127.0.0.1:36962
I20240501 08:11:43.997203 27582 tablet_copy_service.cc:433] P ea3c290047e7442da83cf10d6c197e05: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-200c3f11ec194af394c1c130d22a9663 on tablet 200c3f11ec194af394c1c130d22a9663 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:44.227521 28054 raft_consensus.cc:1203] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:44.328717 28054 raft_consensus.cc:1203] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:44.422902 28054 raft_consensus.cc:1203] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:44.515980 28054 raft_consensus.cc:1203] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:44.649899 28215 raft_consensus.cc:1050] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:44.650797 28215 consensus_queue.cc:237] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:44.653527 27493 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.653921 28054 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.654295 27803 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.654552 28166 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.655506 27421 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.656780 27803 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.660676 28215 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.661095 27423 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.666662 28054 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.667555 27319 catalog_manager.cc:5484] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.671826 27498 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.759838 28178 raft_consensus.cc:1050] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:44.760565 28178 consensus_queue.cc:237] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:44.762923 28054 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.763489 28097 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.764756 27498 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.764757 27570 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:44.765400 28154 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.765713 28178 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:44.770974 28178 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.775076 27498 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.775532 27567 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.777788 27319 catalog_manager.cc:5484] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:44.775166 28054 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.785744 27421 consensus_queue.cc:237] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:44.787909 27498 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:44.788336 28097 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:44.788822 28054 raft_consensus.cc:1261] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:44.789269 28097 consensus_queue.cc:1035] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:44.790803 28178 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.791486 27493 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.794690 27307 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86aa978719c344bca120402ae173afdc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:44.795114 28053 raft_consensus.cc:2932] T 86aa978719c344bca120402ae173afdc P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:44.797313 27318 catalog_manager.cc:5484] T 86aa978719c344bca120402ae173afdc P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:44.801352 27555 tablet_service.cc:1514] Processing DeleteTablet for tablet 86aa978719c344bca120402ae173afdc with delete_type TABLET_DATA_TOMBSTONED (TS ea3c290047e7442da83cf10d6c197e05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59534
I20240501 08:11:44.803380 28232 tablet_replica.cc:330] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: stopping tablet replica
I20240501 08:11:44.803697 28232 raft_consensus.cc:2229] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:44.804945 28232 raft_consensus.cc:2258] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:44.806063 28232 ts_tablet_manager.cc:1875] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:44.811918 28232 ts_tablet_manager.cc:1888] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:44.812083 28232 log.cc:1196] T 86aa978719c344bca120402ae173afdc P ea3c290047e7442da83cf10d6c197e05: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/wals/86aa978719c344bca120402ae173afdc
I20240501 08:11:44.813138 27306 catalog_manager.cc:4830] TS ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): tablet 86aa978719c344bca120402ae173afdc (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:45.005843 28217 raft_consensus.cc:1050] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:45.006621 28217 consensus_queue.cc:237] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:45.008855 28053 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.008906 27421 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.009310 27569 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.009402 28234 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.009807 28217 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.010248 28217 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.015404 27569 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.018347 28053 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.014732 28234 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.021384 27319 catalog_manager.cc:5484] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.024235 27421 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.027402 27498 consensus_queue.cc:237] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:45.029233 27421 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.029973 28053 raft_consensus.cc:1261] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.030352 28142 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.030717 28142 consensus_queue.cc:1035] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.032603 28216 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.033147 27421 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.035959 27308 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b509576adf3c4e2c817f12d3fac6f72b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:45.037999 28053 raft_consensus.cc:2932] T b509576adf3c4e2c817f12d3fac6f72b P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.038774 27318 catalog_manager.cc:5484] T b509576adf3c4e2c817f12d3fac6f72b P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.043314 27555 tablet_service.cc:1514] Processing DeleteTablet for tablet b509576adf3c4e2c817f12d3fac6f72b with delete_type TABLET_DATA_TOMBSTONED (TS ea3c290047e7442da83cf10d6c197e05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59534
I20240501 08:11:45.043623 28232 tablet_replica.cc:330] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: stopping tablet replica
I20240501 08:11:45.043808 28232 raft_consensus.cc:2229] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:45.044045 28232 raft_consensus.cc:2258] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:45.044781 28232 ts_tablet_manager.cc:1875] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:45.050451 28232 ts_tablet_manager.cc:1888] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:45.050580 28232 log.cc:1196] T b509576adf3c4e2c817f12d3fac6f72b P ea3c290047e7442da83cf10d6c197e05: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/wals/b509576adf3c4e2c817f12d3fac6f72b
I20240501 08:11:45.051159 27306 catalog_manager.cc:4830] TS ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): tablet b509576adf3c4e2c817f12d3fac6f72b (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:45.071806 28215 raft_consensus.cc:1050] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:45.072662 28215 consensus_queue.cc:237] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:45.074676 27498 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.074694 28053 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.075196 28215 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.075453 27421 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:45.075528 28219 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.075966 28166 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:45.079026 28166 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.080019 27421 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.083525 28053 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.087590 27319 catalog_manager.cc:5484] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:45.093541 27498 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.097920 27569 consensus_queue.cc:237] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:45.100577 28053 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.100646 27498 raft_consensus.cc:1261] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.101087 27803 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.101361 28215 consensus_queue.cc:1035] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.103914 27803 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.104352 28053 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.104461 27498 raft_consensus.cc:2932] T 200c3f11ec194af394c1c130d22a9663 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.106899 27306 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 200c3f11ec194af394c1c130d22a9663 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:45.110219 27319 catalog_manager.cc:5484] T 200c3f11ec194af394c1c130d22a9663 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.114809 27410 tablet_service.cc:1514] Processing DeleteTablet for tablet 200c3f11ec194af394c1c130d22a9663 with delete_type TABLET_DATA_TOMBSTONED (TS 221d03143b8c485bb23ea0460fd63c93 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49234
I20240501 08:11:45.115573 28242 tablet_replica.cc:330] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: stopping tablet replica
I20240501 08:11:45.115787 28242 raft_consensus.cc:2229] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:45.116114 28242 raft_consensus.cc:2258] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:45.117070 28242 ts_tablet_manager.cc:1875] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:45.123121 28242 ts_tablet_manager.cc:1888] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:45.123242 28242 log.cc:1196] T 200c3f11ec194af394c1c130d22a9663 P 221d03143b8c485bb23ea0460fd63c93: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/wals/200c3f11ec194af394c1c130d22a9663
I20240501 08:11:45.123970 27307 catalog_manager.cc:4830] TS 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): tablet 200c3f11ec194af394c1c130d22a9663 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:45.209759 27567 consensus_queue.cc:237] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:45.211390 28053 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.211690 27493 raft_consensus.cc:1261] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:45.212168 28166 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.212428 28215 consensus_queue.cc:1035] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:45.215023 28219 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.215741 28053 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.215761 27493 raft_consensus.cc:2932] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.220513 27306 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:45.220922 27318 catalog_manager.cc:5484] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:45.224567 27410 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ac20effe8284a15b83bc3fd1a72d8c8 with delete_type TABLET_DATA_TOMBSTONED (TS 221d03143b8c485bb23ea0460fd63c93 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49234
I20240501 08:11:45.225278 28242 tablet_replica.cc:330] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: stopping tablet replica
I20240501 08:11:45.225492 28242 raft_consensus.cc:2229] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:45.225732 28242 raft_consensus.cc:2258] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:45.227365 28242 ts_tablet_manager.cc:1875] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:45.231918 28242 ts_tablet_manager.cc:1888] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:45.232035 28242 log.cc:1196] T 6ac20effe8284a15b83bc3fd1a72d8c8 P 221d03143b8c485bb23ea0460fd63c93: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/wals/6ac20effe8284a15b83bc3fd1a72d8c8
I20240501 08:11:45.232682 27307 catalog_manager.cc:4830] TS 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): tablet 6ac20effe8284a15b83bc3fd1a72d8c8 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:46.243901 27423 consensus_queue.cc:237] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
W20240501 08:11:46.246290 27386 consensus_peers.cc:485] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba41d287ba2a41b39b92d0ef8013d7e6. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:46.246690 27569 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:46.246711 27493 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240501 08:11:46.247231 28245 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.247568 28231 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.249994 28245 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.250811 27493 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.251052 27567 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.256220 27321 catalog_manager.cc:5484] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 2 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.258085 27423 consensus_queue.cc:237] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
W20240501 08:11:46.260731 27386 consensus_peers.cc:485] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44c134f2aacd4ec0b28877d654a63634. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:46.261670 27493 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.261762 27567 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.262207 28231 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.262457 28178 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.265259 28178 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.265905 27567 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.266378 27493 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.274183 27319 catalog_manager.cc:5484] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.277228 27567 consensus_queue.cc:237] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
W20240501 08:11:46.279767 27535 consensus_peers.cc:485] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d391d2e046644170902ab1c13b99bc20. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:46.280411 27493 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.281111 27803 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.281350 27423 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.281771 28219 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.283807 27803 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.284438 27493 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.286911 27421 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.290088 27318 catalog_manager.cc:5484] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240501 08:11:46.292464 27493 consensus_queue.cc:237] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
W20240501 08:11:46.295557 27461 consensus_peers.cc:485] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44e9675c2ea04bb5b611de6d2cebaab1. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:46.298688 27567 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.295382 27421 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:46.299532 28234 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.300063 28234 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:46.302153 28234 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.303166 27421 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.303673 27567 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.308791 27319 catalog_manager.cc:5484] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:46.663600 28261 ts_tablet_manager.cc:902] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
I20240501 08:11:46.665082 28261 tablet_copy_client.cc:308] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.131:39407
I20240501 08:11:46.665776 27582 tablet_copy_service.cc:140] P ea3c290047e7442da83cf10d6c197e05: Received BeginTabletCopySession request for tablet d391d2e046644170902ab1c13b99bc20 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:36962)
I20240501 08:11:46.665885 27582 tablet_copy_service.cc:161] P ea3c290047e7442da83cf10d6c197e05: Beginning new tablet copy session on tablet d391d2e046644170902ab1c13b99bc20 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:36962: session id = 830dd904c2774512a0ed71d30e63b292-d391d2e046644170902ab1c13b99bc20
I20240501 08:11:46.668249 27582 tablet_copy_source_session.cc:205] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:46.669358 28261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d391d2e046644170902ab1c13b99bc20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:46.674942 28261 tablet_copy_client.cc:783] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:46.675339 28261 tablet_copy_client.cc:647] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:46.676901 28261 tablet_copy_client.cc:523] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:46.680009 28261 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:46.682742 28266 ts_tablet_manager.cc:902] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:46.686074 28261 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:46.686460 28261 tablet_bootstrap.cc:492] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:46.686693 28261 ts_tablet_manager.cc:1367] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20240501 08:11:46.687506 28261 raft_consensus.cc:348] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.687695 28261 raft_consensus.cc:729] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:46.687872 28261 consensus_queue.cc:260] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.688684 28261 ts_tablet_manager.cc:1398] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240501 08:11:46.689210 27582 tablet_copy_service.cc:342] P ea3c290047e7442da83cf10d6c197e05: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-d391d2e046644170902ab1c13b99bc20 received from {username='slave'} at 127.0.0.1:36962
I20240501 08:11:46.689301 27582 tablet_copy_service.cc:433] P ea3c290047e7442da83cf10d6c197e05: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-d391d2e046644170902ab1c13b99bc20 on tablet d391d2e046644170902ab1c13b99bc20 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:46.692392 28266 tablet_copy_client.cc:308] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.129:42561
I20240501 08:11:46.693135 27433 tablet_copy_service.cc:140] P 221d03143b8c485bb23ea0460fd63c93: Received BeginTabletCopySession request for tablet 44c134f2aacd4ec0b28877d654a63634 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:53928)
I20240501 08:11:46.693259 27433 tablet_copy_service.cc:161] P 221d03143b8c485bb23ea0460fd63c93: Beginning new tablet copy session on tablet 44c134f2aacd4ec0b28877d654a63634 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:53928: session id = 830dd904c2774512a0ed71d30e63b292-44c134f2aacd4ec0b28877d654a63634
I20240501 08:11:46.695474 27433 tablet_copy_source_session.cc:205] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:46.696525 28266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44c134f2aacd4ec0b28877d654a63634. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:46.701754 28266 tablet_copy_client.cc:783] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:46.701987 28266 tablet_copy_client.cc:647] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:46.703414 28266 tablet_copy_client.cc:523] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:46.706490 28266 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:46.711767 28266 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:46.712201 28266 tablet_bootstrap.cc:492] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:46.712442 28266 ts_tablet_manager.cc:1367] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.007s sys 0.001s
I20240501 08:11:46.713227 28266 raft_consensus.cc:348] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.713471 28266 raft_consensus.cc:729] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:46.713654 28266 consensus_queue.cc:260] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.714394 28266 ts_tablet_manager.cc:1398] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:46.715198 27433 tablet_copy_service.cc:342] P 221d03143b8c485bb23ea0460fd63c93: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-44c134f2aacd4ec0b28877d654a63634 received from {username='slave'} at 127.0.0.1:53928
I20240501 08:11:46.715338 27433 tablet_copy_service.cc:433] P 221d03143b8c485bb23ea0460fd63c93: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-44c134f2aacd4ec0b28877d654a63634 on tablet 44c134f2aacd4ec0b28877d654a63634 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:46.766842 28266 ts_tablet_manager.cc:902] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237)
I20240501 08:11:46.768260 28266 tablet_copy_client.cc:308] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.130:39237
I20240501 08:11:46.769044 27508 tablet_copy_service.cc:140] P 8547734889f841dbbbff809909a0fc3b: Received BeginTabletCopySession request for tablet 44e9675c2ea04bb5b611de6d2cebaab1 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:50836)
I20240501 08:11:46.769191 27508 tablet_copy_service.cc:161] P 8547734889f841dbbbff809909a0fc3b: Beginning new tablet copy session on tablet 44e9675c2ea04bb5b611de6d2cebaab1 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:50836: session id = 830dd904c2774512a0ed71d30e63b292-44e9675c2ea04bb5b611de6d2cebaab1
I20240501 08:11:46.772097 27508 tablet_copy_source_session.cc:205] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:46.773258 28266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44e9675c2ea04bb5b611de6d2cebaab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:46.778698 28266 tablet_copy_client.cc:783] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:46.778906 28266 tablet_copy_client.cc:647] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:46.781391 28266 tablet_copy_client.cc:523] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:46.784358 28266 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:46.790014 28266 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:46.790331 28266 tablet_bootstrap.cc:492] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:46.790511 28266 ts_tablet_manager.cc:1367] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240501 08:11:46.791040 28266 raft_consensus.cc:348] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.791313 28266 raft_consensus.cc:729] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:46.791518 28266 consensus_queue.cc:260] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.792021 28266 ts_tablet_manager.cc:1398] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240501 08:11:46.792951 27508 tablet_copy_service.cc:342] P 8547734889f841dbbbff809909a0fc3b: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-44e9675c2ea04bb5b611de6d2cebaab1 received from {username='slave'} at 127.0.0.1:50836
I20240501 08:11:46.793054 27508 tablet_copy_service.cc:433] P 8547734889f841dbbbff809909a0fc3b: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-44e9675c2ea04bb5b611de6d2cebaab1 on tablet 44e9675c2ea04bb5b611de6d2cebaab1 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:46.840135 28266 ts_tablet_manager.cc:902] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
I20240501 08:11:46.841881 28266 tablet_copy_client.cc:308] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Beginning tablet copy session from remote peer at address 127.25.181.129:42561
I20240501 08:11:46.842460 27433 tablet_copy_service.cc:140] P 221d03143b8c485bb23ea0460fd63c93: Received BeginTabletCopySession request for tablet ba41d287ba2a41b39b92d0ef8013d7e6 from peer 830dd904c2774512a0ed71d30e63b292 ({username='slave'} at 127.0.0.1:53928)
I20240501 08:11:46.842582 27433 tablet_copy_service.cc:161] P 221d03143b8c485bb23ea0460fd63c93: Beginning new tablet copy session on tablet ba41d287ba2a41b39b92d0ef8013d7e6 from peer 830dd904c2774512a0ed71d30e63b292 at {username='slave'} at 127.0.0.1:53928: session id = 830dd904c2774512a0ed71d30e63b292-ba41d287ba2a41b39b92d0ef8013d7e6
I20240501 08:11:46.844980 27433 tablet_copy_source_session.cc:205] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: Tablet Copy: opened 0 blocks and 1 log segments
I20240501 08:11:46.846231 28266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba41d287ba2a41b39b92d0ef8013d7e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240501 08:11:46.852037 28266 tablet_copy_client.cc:783] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 0 data blocks...
I20240501 08:11:46.852257 28266 tablet_copy_client.cc:647] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Starting download of 1 WAL segments...
I20240501 08:11:46.853611 28266 tablet_copy_client.cc:523] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240501 08:11:46.856352 28266 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Bootstrap starting.
I20240501 08:11:46.862164 28266 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240501 08:11:46.862493 28266 tablet_bootstrap.cc:492] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Bootstrap complete.
I20240501 08:11:46.862727 28266 ts_tablet_manager.cc:1367] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.001s
I20240501 08:11:46.863433 28266 raft_consensus.cc:348] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.863667 28266 raft_consensus.cc:729] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 830dd904c2774512a0ed71d30e63b292, State: Initialized, Role: LEARNER
I20240501 08:11:46.863857 28266 consensus_queue.cc:260] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:46.864408 28266 ts_tablet_manager.cc:1398] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240501 08:11:46.866098 27433 tablet_copy_service.cc:342] P 221d03143b8c485bb23ea0460fd63c93: Request end of tablet copy session 830dd904c2774512a0ed71d30e63b292-ba41d287ba2a41b39b92d0ef8013d7e6 received from {username='slave'} at 127.0.0.1:53928
I20240501 08:11:46.866204 27433 tablet_copy_service.cc:433] P 221d03143b8c485bb23ea0460fd63c93: ending tablet copy session 830dd904c2774512a0ed71d30e63b292-ba41d287ba2a41b39b92d0ef8013d7e6 on tablet ba41d287ba2a41b39b92d0ef8013d7e6 with peer 830dd904c2774512a0ed71d30e63b292
I20240501 08:11:47.117614 28053 raft_consensus.cc:1203] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:47.149335 28053 raft_consensus.cc:1203] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:47.264920 28053 raft_consensus.cc:1203] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2] Dedup: 2.2->[]
I20240501 08:11:47.341557 28053 raft_consensus.cc:1203] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240501 08:11:47.681926 28231 raft_consensus.cc:1050] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:47.682713 28231 consensus_queue.cc:237] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.685354 27567 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.685350 28053 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.685806 27498 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.685834 28284 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.686308 28178 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.687367 28284 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.689790 28178 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.690260 27498 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.694396 28053 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.698815 27318 catalog_manager.cc:5484] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.716322 27567 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.718827 27421 consensus_queue.cc:237] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.721364 28053 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.722185 28292 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.723807 27498 raft_consensus.cc:1261] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.724284 28284 consensus_queue.cc:1035] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.724514 28231 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.728531 27498 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.728471 28053 raft_consensus.cc:2932] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.730532 28219 raft_consensus.cc:1050] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:47.731372 28219 consensus_queue.cc:237] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.733865 27307 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 44c134f2aacd4ec0b28877d654a63634 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:47.734570 27321 catalog_manager.cc:5484] T 44c134f2aacd4ec0b28877d654a63634 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER ea3c290047e7442da83cf10d6c197e05 (127.25.181.131) evicted. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.736721 28053 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.736985 27420 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.736985 27498 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.737236 27803 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.737922 27803 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.739153 28219 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.741147 27555 tablet_service.cc:1514] Processing DeleteTablet for tablet 44c134f2aacd4ec0b28877d654a63634 with delete_type TABLET_DATA_TOMBSTONED (TS ea3c290047e7442da83cf10d6c197e05 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59534
I20240501 08:11:47.742036 28234 raft_consensus.cc:1050] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:47.742460 28300 tablet_replica.cc:330] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: stopping tablet replica
I20240501 08:11:47.742733 28300 raft_consensus.cc:2229] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:47.743052 28300 raft_consensus.cc:2258] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:47.743198 28234 consensus_queue.cc:237] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.746296 28054 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 LEARNER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.746308 27567 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.746825 28286 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.747540 28286 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.747925 28300 ts_tablet_manager.cc:1875] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:47.748365 27423 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240501 08:11:47.749280 28234 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.758508 28287 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.763756 27567 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.766624 28300 ts_tablet_manager.cc:1888] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:47.766752 28300 log.cc:1196] T 44c134f2aacd4ec0b28877d654a63634 P ea3c290047e7442da83cf10d6c197e05: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-2-root/wals/44c134f2aacd4ec0b28877d654a63634
I20240501 08:11:47.766378 28285 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.768932 28054 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.770259 27306 catalog_manager.cc:4830] TS ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407): tablet 44c134f2aacd4ec0b28877d654a63634 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:47.771498 28055 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.772207 27321 catalog_manager.cc:5484] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.774163 27421 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.777782 27318 catalog_manager.cc:5484] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.784183 27498 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.787348 27496 consensus_queue.cc:237] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.791538 28054 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.791749 27569 consensus_queue.cc:237] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.793219 28286 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.794188 28055 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.794667 28285 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.795691 27567 raft_consensus.cc:1261] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 8547734889f841dbbbff809909a0fc3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.795691 27421 raft_consensus.cc:1261] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240501 08:11:47.796283 28286 consensus_queue.cc:1035] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.796989 28285 consensus_queue.cc:1035] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.799603 28055 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.799659 27803 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.798996 28306 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P 8547734889f841dbbbff809909a0fc3b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.802928 28054 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 830dd904c2774512a0ed71d30e63b292 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.804462 27306 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d391d2e046644170902ab1c13b99bc20 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:47.805054 27320 catalog_manager.cc:5484] T 44e9675c2ea04bb5b611de6d2cebaab1 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New cstate: current_term: 1 leader_uuid: "8547734889f841dbbbff809909a0fc3b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.806031 27308 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 44e9675c2ea04bb5b611de6d2cebaab1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:47.806288 27319 catalog_manager.cc:5484] T d391d2e046644170902ab1c13b99bc20 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:47.806293 27423 raft_consensus.cc:2932] T d391d2e046644170902ab1c13b99bc20 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.807799 27569 raft_consensus.cc:2932] T 44e9675c2ea04bb5b611de6d2cebaab1 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.811945 27410 tablet_service.cc:1514] Processing DeleteTablet for tablet 44e9675c2ea04bb5b611de6d2cebaab1 with delete_type TABLET_DATA_TOMBSTONED (TS 221d03143b8c485bb23ea0460fd63c93 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49234
I20240501 08:11:47.812338 27482 tablet_service.cc:1514] Processing DeleteTablet for tablet d391d2e046644170902ab1c13b99bc20 with delete_type TABLET_DATA_TOMBSTONED (TS 8547734889f841dbbbff809909a0fc3b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52858
I20240501 08:11:47.813086 28310 tablet_replica.cc:330] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: stopping tablet replica
I20240501 08:11:47.813279 28310 raft_consensus.cc:2229] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:47.813531 28310 raft_consensus.cc:2258] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:47.815037 28310 ts_tablet_manager.cc:1875] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:47.821703 28310 ts_tablet_manager.cc:1888] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:47.821830 28310 log.cc:1196] T d391d2e046644170902ab1c13b99bc20 P 8547734889f841dbbbff809909a0fc3b: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/wals/d391d2e046644170902ab1c13b99bc20
I20240501 08:11:47.822546 27308 catalog_manager.cc:4830] TS 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): tablet d391d2e046644170902ab1c13b99bc20 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:47.823746 28309 tablet_replica.cc:330] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: stopping tablet replica
I20240501 08:11:47.823972 28309 raft_consensus.cc:2229] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:47.824224 28309 pending_rounds.cc:62] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Trying to abort 1 pending ops.
I20240501 08:11:47.824375 28309 pending_rounds.cc:68] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7022801337313366016 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "44e9675c2ea04bb5b611de6d2cebaab1" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } } }
I20240501 08:11:47.825172 28309 raft_consensus.cc:2894] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20240501 08:11:47.825280 28309 raft_consensus.cc:2866] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240501 08:11:47.825403 28309 raft_consensus.cc:2258] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:47.826210 28309 ts_tablet_manager.cc:1875] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:47.831441 28309 ts_tablet_manager.cc:1888] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240501 08:11:47.831569 28309 log.cc:1196] T 44e9675c2ea04bb5b611de6d2cebaab1 P 221d03143b8c485bb23ea0460fd63c93: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-0-root/wals/44e9675c2ea04bb5b611de6d2cebaab1
I20240501 08:11:47.832582 27307 catalog_manager.cc:4830] TS 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561): tablet 44e9675c2ea04bb5b611de6d2cebaab1 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:47.838557 28178 raft_consensus.cc:1050] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93: attempting to promote NON_VOTER 830dd904c2774512a0ed71d30e63b292 to VOTER
I20240501 08:11:47.839197 28178 consensus_queue.cc:237] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.841384 28054 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 LEARNER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20240501 08:11:47.841867 28292 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.842360 27569 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20240501 08:11:47.842839 28284 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.844892 27498 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20240501 08:11:47.845391 28178 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240501 08:11:47.848016 28284 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.848930 27569 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.849900 27498 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.853890 28054 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.859025 27318 catalog_manager.cc:5484] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 reported cstate change: config changed from index 2 to 3, 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240501 08:11:47.864104 27423 consensus_queue.cc:237] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } }
I20240501 08:11:47.865962 27567 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20240501 08:11:47.865994 28054 raft_consensus.cc:1261] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20240501 08:11:47.866487 28178 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.866761 28231 consensus_queue.cc:1035] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240501 08:11:47.869628 28231 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 221d03143b8c485bb23ea0460fd63c93 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.870164 28054 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.871265 27567 raft_consensus.cc:2932] T ba41d287ba2a41b39b92d0ef8013d7e6 P ea3c290047e7442da83cf10d6c197e05 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.875093 27307 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ba41d287ba2a41b39b92d0ef8013d7e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240501 08:11:47.876262 27320 catalog_manager.cc:5484] T ba41d287ba2a41b39b92d0ef8013d7e6 P 830dd904c2774512a0ed71d30e63b292 reported cstate change: config changed from index 3 to 4, VOTER 8547734889f841dbbbff809909a0fc3b (127.25.181.130) evicted. New cstate: current_term: 2 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: false } } }
I20240501 08:11:47.879423 27482 tablet_service.cc:1514] Processing DeleteTablet for tablet ba41d287ba2a41b39b92d0ef8013d7e6 with delete_type TABLET_DATA_TOMBSTONED (TS 8547734889f841dbbbff809909a0fc3b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:52858
I20240501 08:11:47.879921 28310 tablet_replica.cc:330] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: stopping tablet replica
I20240501 08:11:47.880131 28310 raft_consensus.cc:2229] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20240501 08:11:47.880374 28310 raft_consensus.cc:2258] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20240501 08:11:47.881191 28310 ts_tablet_manager.cc:1875] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240501 08:11:47.885982 28310 ts_tablet_manager.cc:1888] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20240501 08:11:47.886070 28310 log.cc:1196] T ba41d287ba2a41b39b92d0ef8013d7e6 P 8547734889f841dbbbff809909a0fc3b: Deleting WAL directory at /tmp/dist-test-tasklWjVYH/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714551040672050-26326-0/minicluster-data/ts-1-root/wals/ba41d287ba2a41b39b92d0ef8013d7e6
I20240501 08:11:47.886617 27308 catalog_manager.cc:4830] TS 8547734889f841dbbbff809909a0fc3b (127.25.181.130:39237): tablet ba41d287ba2a41b39b92d0ef8013d7e6 (table test-workload [id=4d928ffa4e66459aa2a8604c274f30e8]) successfully deleted
I20240501 08:11:48.892545 27569 consensus_queue.cc:237] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:48.894878 27496 raft_consensus.cc:1261] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:48.894950 27535 consensus_peers.cc:485] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d93678464084b9884fd9eb4c2659ff6. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:48.895208 27423 raft_consensus.cc:1261] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Refusing update from remote peer ea3c290047e7442da83cf10d6c197e05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:48.895402 28315 consensus_queue.cc:1035] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.895802 28219 consensus_queue.cc:1035] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.898795 27496 raft_consensus.cc:2932] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.898926 27423 raft_consensus.cc:2932] T 2d93678464084b9884fd9eb4c2659ff6 P 221d03143b8c485bb23ea0460fd63c93 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.900712 28315 raft_consensus.cc:2932] T 2d93678464084b9884fd9eb4c2659ff6 P ea3c290047e7442da83cf10d6c197e05 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.903528 27319 catalog_manager.cc:5484] T 2d93678464084b9884fd9eb4c2659ff6 P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "ea3c290047e7442da83cf10d6c197e05" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } attrs { replace: true } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.908481 27421 consensus_queue.cc:237] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:48.912003 27496 raft_consensus.cc:1261] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:48.912179 27386 consensus_peers.cc:485] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1583f6f65abf4411a937349cff09bb6b. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:48.912868 27567 raft_consensus.cc:1261] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:48.913347 28292 consensus_queue.cc:1035] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.913717 28178 consensus_queue.cc:1035] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.916154 28231 raft_consensus.cc:2932] T 1583f6f65abf4411a937349cff09bb6b P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.917762 27567 raft_consensus.cc:2932] T 1583f6f65abf4411a937349cff09bb6b P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.919536 27496 raft_consensus.cc:2932] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.924593 27319 catalog_manager.cc:5484] T 1583f6f65abf4411a937349cff09bb6b P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.929332 27423 consensus_queue.cc:237] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:48.931422 27567 raft_consensus.cc:1261] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:48.932072 28231 consensus_queue.cc:1035] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240501 08:11:48.931599 27386 consensus_peers.cc:485] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d545eb1aba64bdfba55e84f51514fa4. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:48.931438 27496 raft_consensus.cc:1261] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:48.933283 28231 consensus_queue.cc:1035] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.934345 28231 raft_consensus.cc:2932] T 8d545eb1aba64bdfba55e84f51514fa4 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.935106 27569 raft_consensus.cc:2932] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.939935 27321 catalog_manager.cc:5484] T 8d545eb1aba64bdfba55e84f51514fa4 P ea3c290047e7442da83cf10d6c197e05 reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.943636 27423 consensus_queue.cc:237] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } }
I20240501 08:11:48.946296 27498 raft_consensus.cc:1261] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240501 08:11:48.946574 27569 raft_consensus.cc:1261] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Refusing update from remote peer 221d03143b8c485bb23ea0460fd63c93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240501 08:11:48.946974 27386 consensus_peers.cc:485] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 -> Peer 830dd904c2774512a0ed71d30e63b292 (127.25.181.132:40305): Couldn't send request to peer 830dd904c2774512a0ed71d30e63b292. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e87b258f8974e47a9ce6295482b0538. This is attempt 1: this message will repeat every 5th retry.
I20240501 08:11:48.947124 28292 consensus_queue.cc:1035] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240501 08:11:48.952658 28178 raft_consensus.cc:2932] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.953297 27498 raft_consensus.cc:2932] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.952986 28292 consensus_queue.cc:1035] T 6e87b258f8974e47a9ce6295482b0538 P 221d03143b8c485bb23ea0460fd63c93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20240501 08:11:48.959715 27496 raft_consensus.cc:2932] T 8d545eb1aba64bdfba55e84f51514fa4 P 8547734889f841dbbbff809909a0fc3b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } attrs { replace: true } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.960141 27319 catalog_manager.cc:5484] T 6e87b258f8974e47a9ce6295482b0538 P 8547734889f841dbbbff809909a0fc3b reported cstate change: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New cstate: current_term: 1 leader_uuid: "221d03143b8c485bb23ea0460fd63c93" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:48.961126 27569 raft_consensus.cc:2932] T 6e87b258f8974e47a9ce6295482b0538 P ea3c290047e7442da83cf10d6c197e05 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 830dd904c2774512a0ed71d30e63b292 (127.25.181.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "221d03143b8c485bb23ea0460fd63c93" member_type: VOTER last_known_addr { host: "127.25.181.129" port: 42561 } } peers { permanent_uuid: "8547734889f841dbbbff809909a0fc3b" member_type: VOTER last_known_addr { host: "127.25.181.130" port: 39237 } } peers { permanent_uuid: "ea3c290047e7442da83cf10d6c197e05" member_type: VOTER last_known_addr { host: "127.25.181.131" port: 39407 } attrs { replace: true } } peers { permanent_uuid: "830dd904c2774512a0ed71d30e63b292" member_type: NON_VOTER last_known_addr { host: "127.25.181.132" port: 40305 } attrs { promote: true } } }
I20240501 08:11:49.323916 28335 ts_tablet_manager.cc:902] T 2d93678464084b9884fd9eb4c2659ff6 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer ea3c290047e7442da83cf10d6c197e05 (127.25.181.131:39407)
F20240501 08:11:49.324671 28335 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-200c3f11ec194af394c1c130d22a9663.queue_time_us, tablet-download-pool-200c3f11ec194af394c1c130d22a9663.queue_time_us) (tablet-download-pool-200c3f11ec194af394c1c130d22a9663.run_cpu_time_us, tablet-download-pool-200c3f11ec194af394c1c130d22a9663.run_cpu_time_us) (tablet-download-pool-200c3f11ec194af394c1c130d22a9663.run_wall_time_us, tablet-download-pool-200c3f11ec194af394c1c130d22a9663.run_wall_time_us) (tablet-download-pool-2d93678464084b9884fd9eb4c2659ff6.queue_time_us, tablet-download-pool-2d93678464084b9884fd9eb4c2659ff6.queue_time_us) (tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.queue_time_us, tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.queue_time_us) (tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.run_cpu_time_us, tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.run_cpu_time_us) (tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.run_wall_time_us, tablet-download-pool-44c134f2aacd4ec0b28877d654a63634.run_wall_time_us) (tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.queue_time_us, tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.queue_time_us) (tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.run_cpu_time_us, tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.run_cpu_time_us) (tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.run_wall_time_us, tablet-download-pool-44e9675c2ea04bb5b611de6d2cebaab1.run_wall_time_us) (tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.queue_time_us, tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.queue_time_us) (tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.run_cpu_time_us, tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.run_cpu_time_us) (tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.run_wall_time_us, tablet-download-pool-6ac20effe8284a15b83bc3fd1a72d8c8.run_wall_time_us) (tablet-download-pool-86aa978719c344bca120402ae173afdc.queue_time_us, tablet-download-pool-86aa978719c344bca120402ae173afdc.queue_time_us) (tablet-download-pool-86aa978719c344bca120402ae173afdc.run_cpu_time_us, tablet-download-pool-86aa978719c344bca120402ae173afdc.run_cpu_time_us) (tablet-download-pool-86aa978719c344bca120402ae173afdc.run_wall_time_us, tablet-download-pool-86aa978719c344bca120402ae173afdc.run_wall_time_us) (tablet-download-pool-a751f6bbfc764eac871066bee792832c.queue_time_us, tablet-download-pool-a751f6bbfc764eac871066bee792832c.queue_time_us) (tablet-download-pool-a751f6bbfc764eac871066bee792832c.run_cpu_time_us, tablet-download-pool-a751f6bbfc764eac871066bee792832c.run_cpu_time_us) (tablet-download-pool-a751f6bbfc764eac871066bee792832c.run_wall_time_us, tablet-download-pool-a751f6bbfc764eac871066bee792832c.run_wall_time_us) (tablet-download-pool-b078e697a866402083f8b9b79695016b.queue_time_us, tablet-download-pool-b078e697a866402083f8b9b79695016b.queue_time_us) (tablet-download-pool-b078e697a866402083f8b9b79695016b.run_cpu_time_us, tablet-download-pool-b078e697a866402083f8b9b79695016b.run_cpu_time_us) (tablet-download-pool-b078e697a866402083f8b9b79695016b.run_wall_time_us, tablet-download-pool-b078e697a866402083f8b9b79695016b.run_wall_time_us) (tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.queue_time_us, tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.queue_time_us) (tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.run_cpu_time_us, tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.run_cpu_time_us) (tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.run_wall_time_us, tablet-download-pool-b509576adf3c4e2c817f12d3fac6f72b.run_wall_time_us) (tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.queue_time_us, tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.queue_time_us) (tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.run_cpu_time_us, tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.run_cpu_time_us) (tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.run_wall_time_us, tablet-download-pool-b8d4c7a91a1440b1b8c2cb6d749c44f8.run_wall_time_us) (tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.queue_time_us, tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.queue_time_us) (tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.run_cpu_time_us, tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.run_cpu_time_us) (tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.run_wall_time_us, tablet-download-pool-ba41d287ba2a41b39b92d0ef8013d7e6.run_wall_time_us) (tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.queue_time_us, tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.queue_time_us) (tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.run_cpu_time_us, tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.run_cpu_time_us) (tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.run_wall_time_us, tablet-download-pool-cd5ccea69adc48058e2f17dd9901eb8a.run_wall_time_us) (tablet-download-pool-d391d2e046644170902ab1c13b99bc20.queue_time_us, tablet-download-pool-d391d2e046644170902ab1c13b99bc20.queue_time_us) (tablet-download-pool-d391d2e046644170902ab1c13b99bc20.run_cpu_time_us, tablet-download-pool-d391d2e046644170902ab1c13b99bc20.run_cpu_time_us) (tablet-download-pool-d391d2e046644170902ab1c13b99bc20.run_wall_time_us, tablet-download-pool-d391d2e046644170902ab1c13b99bc20.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714551109 (unix time) try "date -d @1714551109" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000066d6) received by PID 26326 (TID 0x7efd8320a700) from PID 26326; stack trace: ***
@ 0x7efe30012980 (unknown) at ??:0
@ 0x7efe2535ffb7 gsignal at ??:0
@ 0x7efe25361921 abort at ??:0
@ 0x7efe27e14dcd google::LogMessage::Fail() at ??:0
@ 0x7efe27e18b93 google::LogMessage::SendToLog() at ??:0
@ 0x7efe27e147cc google::LogMessage::Flush() at ??:0
@ 0x7efe27e15f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efe29491742 kudu::TraceMetrics::InternName() at ??:0
@ 0x7efe2945df8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7efe29457cd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240501 08:11:49.372656 28344 ts_tablet_manager.cc:902] T 6e87b258f8974e47a9ce6295482b0538 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
@ 0x7efe389238de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7efe3893bdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7efe38a66480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7efe38a9ea8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7efe38a81981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7efe38a8170e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7efe3d92398d std::function<>::operator()() at ??:0
@ 0x7efe29461b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efe2946519c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7efe29465019 std::_Function_handler<>::_M_invoke() at ??:0
I20240501 08:11:49.433509 28357 ts_tablet_manager.cc:902] T 8d545eb1aba64bdfba55e84f51514fa4 P 830dd904c2774512a0ed71d30e63b292: Initiating tablet copy from peer 221d03143b8c485bb23ea0460fd63c93 (127.25.181.129:42561)
@ 0x7efe3d92398d std::function<>::operator()() at ??:0
@ 0x7efe2944001e kudu::Thread::SuperviseThread() at ??:0
@ 0x7efe300076db start_thread at ??:0
@ 0x7efe2544271f clone at ??:0