[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240503 14:11:55.269147 12294 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.190:39533
I20240503 14:11:55.271092 12294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240503 14:11:55.272611 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:11:55.285691 12300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.286266 12302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.286671 12299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.287235 12294 server_base.cc:1034] running on GCE node
I20240503 14:11:55.288291 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:11:55.288509 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:11:55.288625 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745515288589 us; error 0 us; skew 500 ppm
I20240503 14:11:55.289040 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:11:55.292579 12294 webserver.cc:460] Webserver started at http://127.12.1.190:44629/ using document root <none> and password file <none>
I20240503 14:11:55.293540 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:11:55.293694 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:11:55.294174 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:11:55.298293 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/master-0-root/instance:
uuid: "3a18f19e2642409583c75b5ad23f59d3"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.306023 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20240503 14:11:55.310523 12307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.312541 12294 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20240503 14:11:55.312814 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/master-0-root
uuid: "3a18f19e2642409583c75b5ad23f59d3"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.313056 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:11:55.351612 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:11:55.352612 12294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240503 14:11:55.352950 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:11:55.373404 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.190:39533
I20240503 14:11:55.373409 12358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.190:39533 every 8 connection(s)
I20240503 14:11:55.379138 12359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.393886 12359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: Bootstrap starting.
I20240503 14:11:55.398285 12359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:55.399643 12359 log.cc:824] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: Log is configured to *not* fsync() on all Append() calls
I20240503 14:11:55.403061 12359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: No bootstrap required, opened a new log
I20240503 14:11:55.411331 12359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER }
I20240503 14:11:55.411717 12359 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:55.411844 12359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a18f19e2642409583c75b5ad23f59d3, State: Initialized, Role: FOLLOWER
I20240503 14:11:55.412714 12359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER }
I20240503 14:11:55.412983 12359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:11:55.413141 12359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:11:55.413333 12359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:55.415679 12359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER }
I20240503 14:11:55.416394 12359 leader_election.cc:302] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a18f19e2642409583c75b5ad23f59d3; no voters:
I20240503 14:11:55.417194 12359 leader_election.cc:288] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:11:55.417357 12362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:55.418164 12362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 1 LEADER]: Becoming Leader. State: Replica: 3a18f19e2642409583c75b5ad23f59d3, State: Running, Role: LEADER
I20240503 14:11:55.418934 12362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER }
I20240503 14:11:55.419768 12359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:11:55.422567 12364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a18f19e2642409583c75b5ad23f59d3. Latest consensus state: current_term: 1 leader_uuid: "3a18f19e2642409583c75b5ad23f59d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER } }
I20240503 14:11:55.422570 12363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a18f19e2642409583c75b5ad23f59d3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a18f19e2642409583c75b5ad23f59d3" member_type: VOTER } }
I20240503 14:11:55.423049 12364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [sys.catalog]: This master's current role is: LEADER
I20240503 14:11:55.423050 12363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [sys.catalog]: This master's current role is: LEADER
I20240503 14:11:55.424958 12370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:11:55.431787 12370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:11:55.432540 12294 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 14:11:55.443746 12370 catalog_manager.cc:1347] Generated new cluster ID: 7a8acd6357ec43dbb3a606d9f5e0de1d
I20240503 14:11:55.443900 12370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:11:55.467161 12370 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:11:55.469178 12370 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:11:55.483589 12370 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: Generated new TSK 0
I20240503 14:11:55.484751 12370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:11:55.498425 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:11:55.503459 12381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.504199 12382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.504992 12384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.506055 12294 server_base.cc:1034] running on GCE node
I20240503 14:11:55.506408 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:11:55.506517 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:11:55.506579 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745515506557 us; error 0 us; skew 500 ppm
I20240503 14:11:55.506799 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:11:55.508309 12294 webserver.cc:460] Webserver started at http://127.12.1.129:43397/ using document root <none> and password file <none>
I20240503 14:11:55.508571 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:11:55.508669 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:11:55.508836 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:11:55.509570 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-0-root/instance:
uuid: "e12cd3e1edfd4acd81d026936404aa05"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.512815 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240503 14:11:55.515035 12389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.515492 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:11:55.515635 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
uuid: "e12cd3e1edfd4acd81d026936404aa05"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.515779 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:11:55.528920 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:11:55.529707 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:11:55.530772 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:11:55.532537 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:11:55.532685 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.532855 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:11:55.532941 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.554190 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.129:43859
I20240503 14:11:55.554230 12451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.129:43859 every 8 connection(s)
I20240503 14:11:55.556293 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:11:55.564514 12454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.565554 12457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.580724 12294 server_base.cc:1034] running on GCE node
I20240503 14:11:55.581918 12452 heartbeater.cc:347] Connected to a master server at 127.12.1.190:39533
I20240503 14:11:55.582417 12452 heartbeater.cc:464] Registering TS with master...
I20240503 14:11:55.583532 12452 heartbeater.cc:511] Master 127.12.1.190:39533 requested a full tablet report, sending...
I20240503 14:11:55.586361 12324 ts_manager.cc:194] Registered new tserver with Master: e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859)
W20240503 14:11:55.587989 12459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.588645 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:11:55.588762 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:11:55.588742 12324 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56926
I20240503 14:11:55.588945 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745515588903 us; error 0 us; skew 500 ppm
I20240503 14:11:55.589156 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:11:55.591048 12294 webserver.cc:460] Webserver started at http://127.12.1.130:35777/ using document root <none> and password file <none>
I20240503 14:11:55.591399 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:11:55.591532 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:11:55.591719 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:11:55.592655 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-1-root/instance:
uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.596576 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20240503 14:11:55.599318 12464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.599872 12294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240503 14:11:55.600039 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.600240 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:11:55.630033 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:11:55.630820 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:11:55.631542 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:11:55.632625 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:11:55.632714 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.632850 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:11:55.632917 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.656306 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.130:33613
I20240503 14:11:55.656383 12526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.130:33613 every 8 connection(s)
I20240503 14:11:55.658475 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:11:55.663084 12530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:11:55.664510 12531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.669629 12294 server_base.cc:1034] running on GCE node
W20240503 14:11:55.670173 12533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:11:55.670610 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:11:55.670723 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:11:55.670816 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745515670779 us; error 0 us; skew 500 ppm
I20240503 14:11:55.671021 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:11:55.672828 12294 webserver.cc:460] Webserver started at http://127.12.1.131:37367/ using document root <none> and password file <none>
I20240503 14:11:55.673120 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:11:55.673223 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:11:55.673380 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:11:55.674264 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-2-root/instance:
uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.678094 12527 heartbeater.cc:347] Connected to a master server at 127.12.1.190:39533
I20240503 14:11:55.678284 12527 heartbeater.cc:464] Registering TS with master...
I20240503 14:11:55.678768 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20240503 14:11:55.678967 12527 heartbeater.cc:511] Master 127.12.1.190:39533 requested a full tablet report, sending...
I20240503 14:11:55.680230 12324 ts_manager.cc:194] Registered new tserver with Master: 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:55.681412 12324 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56940
I20240503 14:11:55.683262 12538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.683758 12294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20240503 14:11:55.683910 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
format_stamp: "Formatted at 2024-05-03 14:11:55 on dist-test-slave-6fwv"
I20240503 14:11:55.684069 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1714745515193609-12294-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:11:55.732758 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:11:55.733516 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:11:55.734282 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:11:55.735800 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:11:55.735901 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.736042 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:11:55.736124 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:11:55.760932 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.131:40757
I20240503 14:11:55.760974 12600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.131:40757 every 8 connection(s)
I20240503 14:11:55.772531 12601 heartbeater.cc:347] Connected to a master server at 127.12.1.190:39533
I20240503 14:11:55.772799 12601 heartbeater.cc:464] Registering TS with master...
I20240503 14:11:55.773594 12601 heartbeater.cc:511] Master 127.12.1.190:39533 requested a full tablet report, sending...
I20240503 14:11:55.775103 12324 ts_manager.cc:194] Registered new tserver with Master: 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:55.775491 12294 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013142582s
I20240503 14:11:55.776523 12324 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56948
I20240503 14:11:55.777400 12294 test_util.cc:268] Using random seed: 1297685843
I20240503 14:11:55.806854 12324 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56956:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 14:11:55.809422 12324 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 14:11:55.868372 12566 tablet_service.cc:1467] Processing CreateTablet for tablet 802e1d937888433d950994c73187f1b1 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 14:11:55.869478 12566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802e1d937888433d950994c73187f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.869661 12417 tablet_service.cc:1467] Processing CreateTablet for tablet 802e1d937888433d950994c73187f1b1 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 14:11:55.869910 12416 tablet_service.cc:1467] Processing CreateTablet for tablet deef35a04f044b9b881b35e3b42b38c9 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 14:11:55.870404 12417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802e1d937888433d950994c73187f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.871198 12415 tablet_service.cc:1467] Processing CreateTablet for tablet 955de46327ff4b41813ba3250c5dcc6d (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 14:11:55.874718 12416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deef35a04f044b9b881b35e3b42b38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.878242 12415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955de46327ff4b41813ba3250c5dcc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.878729 12565 tablet_service.cc:1467] Processing CreateTablet for tablet deef35a04f044b9b881b35e3b42b38c9 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 14:11:55.879364 12565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deef35a04f044b9b881b35e3b42b38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.881867 12414 tablet_service.cc:1467] Processing CreateTablet for tablet c53da463a00c4dc290e69699630b20e3 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 14:11:55.883074 12562 tablet_service.cc:1467] Processing CreateTablet for tablet 17467865e2f34ddab23c7ca92e20a8fb (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 14:11:55.881970 12564 tablet_service.cc:1467] Processing CreateTablet for tablet 955de46327ff4b41813ba3250c5dcc6d (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 14:11:55.888100 12563 tablet_service.cc:1467] Processing CreateTablet for tablet c53da463a00c4dc290e69699630b20e3 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 14:11:55.886844 12412 tablet_service.cc:1467] Processing CreateTablet for tablet 52c11ce2d2844ce68ba9c67ba58cac17 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 14:11:55.889941 12414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53da463a00c4dc290e69699630b20e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.890144 12413 tablet_service.cc:1467] Processing CreateTablet for tablet 17467865e2f34ddab23c7ca92e20a8fb (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 14:11:55.892414 12562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17467865e2f34ddab23c7ca92e20a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.891824 12410 tablet_service.cc:1467] Processing CreateTablet for tablet 7967ddb7aa5840d9a086219e31f810aa (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 14:11:55.895854 12563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53da463a00c4dc290e69699630b20e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.893404 12409 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 14:11:55.893088 12560 tablet_service.cc:1467] Processing CreateTablet for tablet a2d56e5f67114535a065e46acb45aaab (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 14:11:55.894307 12561 tablet_service.cc:1467] Processing CreateTablet for tablet 52c11ce2d2844ce68ba9c67ba58cac17 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 14:11:55.897348 12411 tablet_service.cc:1467] Processing CreateTablet for tablet a2d56e5f67114535a065e46acb45aaab (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 14:11:55.898888 12413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17467865e2f34ddab23c7ca92e20a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.900013 12564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955de46327ff4b41813ba3250c5dcc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.899813 12558 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 14:11:55.904847 12412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c11ce2d2844ce68ba9c67ba58cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.901347 12490 tablet_service.cc:1467] Processing CreateTablet for tablet 955de46327ff4b41813ba3250c5dcc6d (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20240503 14:11:55.902809 12489 tablet_service.cc:1467] Processing CreateTablet for tablet c53da463a00c4dc290e69699630b20e3 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20240503 14:11:55.907840 12560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d56e5f67114535a065e46acb45aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.906337 12492 tablet_service.cc:1467] Processing CreateTablet for tablet 802e1d937888433d950994c73187f1b1 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20240503 14:11:55.910094 12409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.901485 12559 tablet_service.cc:1467] Processing CreateTablet for tablet 7967ddb7aa5840d9a086219e31f810aa (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 14:11:55.909663 12491 tablet_service.cc:1467] Processing CreateTablet for tablet deef35a04f044b9b881b35e3b42b38c9 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20240503 14:11:55.912580 12561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c11ce2d2844ce68ba9c67ba58cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.913635 12486 tablet_service.cc:1467] Processing CreateTablet for tablet a2d56e5f67114535a065e46acb45aaab (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20240503 14:11:55.912662 12487 tablet_service.cc:1467] Processing CreateTablet for tablet 52c11ce2d2844ce68ba9c67ba58cac17 (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20240503 14:11:55.915082 12485 tablet_service.cc:1467] Processing CreateTablet for tablet 7967ddb7aa5840d9a086219e31f810aa (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20240503 14:11:55.915226 12490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 955de46327ff4b41813ba3250c5dcc6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.912570 12488 tablet_service.cc:1467] Processing CreateTablet for tablet 17467865e2f34ddab23c7ca92e20a8fb (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20240503 14:11:55.916230 12484 tablet_service.cc:1467] Processing CreateTablet for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f (DEFAULT_TABLE table=test-workload [id=147c68b6e4554f1a834a557129a29f0b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20240503 14:11:55.917665 12411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d56e5f67114535a065e46acb45aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.917797 12491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deef35a04f044b9b881b35e3b42b38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.918679 12558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.920317 12485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7967ddb7aa5840d9a086219e31f810aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.923516 12559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7967ddb7aa5840d9a086219e31f810aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.924027 12410 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7967ddb7aa5840d9a086219e31f810aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.926287 12489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53da463a00c4dc290e69699630b20e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.932459 12487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c11ce2d2844ce68ba9c67ba58cac17. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.936627 12488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17467865e2f34ddab23c7ca92e20a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.941373 12484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5b1eb7d2b36b42fb800e1b0d4a14c33f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.953722 12486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2d56e5f67114535a065e46acb45aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.955618 12492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 802e1d937888433d950994c73187f1b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:11:55.969493 12617 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:55.989204 12616 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.030686 12616 tablet_bootstrap.cc:654] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.041620 12617 tablet_bootstrap.cc:654] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.053648 12618 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.056953 12618 tablet_bootstrap.cc:654] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.059849 12618 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.060068 12618 ts_tablet_manager.cc:1367] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20240503 14:11:56.060925 12618 raft_consensus.cc:348] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.061187 12618 raft_consensus.cc:374] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.061302 12618 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.061633 12618 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.062994 12527 heartbeater.cc:503] Master 127.12.1.190:39533 was elected leader, sending a full tablet report...
I20240503 14:11:56.063719 12617 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.063916 12617 ts_tablet_manager.cc:1367] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.098s user 0.007s sys 0.006s
I20240503 14:11:56.062709 12618 ts_tablet_manager.cc:1398] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240503 14:11:56.064966 12618 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.065222 12617 raft_consensus.cc:348] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.065523 12617 raft_consensus.cc:374] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.065622 12617 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.065904 12617 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.067153 12618 tablet_bootstrap.cc:654] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.071061 12616 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.071297 12616 ts_tablet_manager.cc:1367] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.086s user 0.007s sys 0.000s
I20240503 14:11:56.072404 12616 raft_consensus.cc:348] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.072660 12616 raft_consensus.cc:374] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.072770 12616 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.073256 12618 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.073069 12616 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.073454 12618 ts_tablet_manager.cc:1367] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s
I20240503 14:11:56.074465 12618 raft_consensus.cc:348] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.075448 12618 raft_consensus.cc:374] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.075573 12618 raft_consensus.cc:729] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.075887 12618 consensus_queue.cc:260] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.076503 12618 ts_tablet_manager.cc:1398] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 14:11:56.077003 12618 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.079182 12617 ts_tablet_manager.cc:1398] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.015s user 0.005s sys 0.010s
I20240503 14:11:56.079193 12601 heartbeater.cc:503] Master 127.12.1.190:39533 was elected leader, sending a full tablet report...
I20240503 14:11:56.079545 12617 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.079649 12618 tablet_bootstrap.cc:654] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.082302 12617 tablet_bootstrap.cc:654] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.085893 12452 heartbeater.cc:503] Master 127.12.1.190:39533 was elected leader, sending a full tablet report...
I20240503 14:11:56.086340 12616 ts_tablet_manager.cc:1398] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.015s user 0.004s sys 0.007s
I20240503 14:11:56.086874 12616 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.093945 12616 tablet_bootstrap.cc:654] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.097205 12617 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.097448 12617 ts_tablet_manager.cc:1367] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.008s
I20240503 14:11:56.098464 12617 raft_consensus.cc:348] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.098748 12617 raft_consensus.cc:374] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.098853 12617 raft_consensus.cc:729] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.099231 12616 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.099171 12617 consensus_queue.cc:260] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.099668 12618 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.099850 12618 ts_tablet_manager.cc:1367] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.009s
I20240503 14:11:56.100150 12617 ts_tablet_manager.cc:1398] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:11:56.100541 12617 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.100783 12618 raft_consensus.cc:348] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.101019 12618 raft_consensus.cc:374] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.101133 12618 raft_consensus.cc:729] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.101413 12618 consensus_queue.cc:260] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.101716 12616 ts_tablet_manager.cc:1367] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s
I20240503 14:11:56.103369 12618 ts_tablet_manager.cc:1398] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:11:56.103471 12616 raft_consensus.cc:348] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.103901 12616 raft_consensus.cc:374] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.103915 12618 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.104032 12616 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.104656 12616 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.105895 12617 tablet_bootstrap.cc:654] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.106786 12616 ts_tablet_manager.cc:1398] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 14:11:56.107197 12618 tablet_bootstrap.cc:654] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.107702 12616 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.110469 12616 tablet_bootstrap.cc:654] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.115644 12618 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.115865 12618 ts_tablet_manager.cc:1367] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.009s
I20240503 14:11:56.116973 12618 raft_consensus.cc:348] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.117233 12618 raft_consensus.cc:374] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.117309 12618 raft_consensus.cc:729] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.117568 12618 consensus_queue.cc:260] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.118067 12618 ts_tablet_manager.cc:1398] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240503 14:11:56.118453 12618 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.120334 12618 tablet_bootstrap.cc:654] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.120658 12617 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.121620 12617 ts_tablet_manager.cc:1367] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.000s
I20240503 14:11:56.122678 12617 raft_consensus.cc:348] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.123369 12617 raft_consensus.cc:374] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.123502 12617 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.123837 12617 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.124253 12618 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.124462 12617 ts_tablet_manager.cc:1398] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:11:56.124466 12618 ts_tablet_manager.cc:1367] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20240503 14:11:56.124903 12617 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.125385 12618 raft_consensus.cc:348] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.125684 12618 raft_consensus.cc:374] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.125798 12618 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.126201 12618 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.126986 12618 ts_tablet_manager.cc:1398] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:11:56.127086 12617 tablet_bootstrap.cc:654] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.127303 12618 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.129967 12616 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.130183 12616 ts_tablet_manager.cc:1367] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.014s
I20240503 14:11:56.130445 12618 tablet_bootstrap.cc:654] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.131068 12616 raft_consensus.cc:348] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.131304 12616 raft_consensus.cc:374] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.131402 12616 raft_consensus.cc:729] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.131624 12616 consensus_queue.cc:260] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.132236 12616 ts_tablet_manager.cc:1398] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:11:56.132548 12616 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.134420 12616 tablet_bootstrap.cc:654] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.138702 12623 raft_consensus.cc:482] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.138844 12618 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.139047 12618 ts_tablet_manager.cc:1367] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.002s
I20240503 14:11:56.138916 12623 raft_consensus.cc:504] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.139967 12618 raft_consensus.cc:348] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.140224 12618 raft_consensus.cc:374] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.140348 12618 raft_consensus.cc:729] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.140676 12618 consensus_queue.cc:260] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.141131 12623 leader_election.cc:288] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859)
I20240503 14:11:56.141382 12618 ts_tablet_manager.cc:1398] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20240503 14:11:56.141767 12618 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.144135 12618 tablet_bootstrap.cc:654] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.147524 12617 tablet_bootstrap.cc:492] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.147836 12617 ts_tablet_manager.cc:1367] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.005s
I20240503 14:11:56.148515 12616 tablet_bootstrap.cc:492] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.148701 12616 ts_tablet_manager.cc:1367] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
I20240503 14:11:56.149045 12617 raft_consensus.cc:348] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.149418 12617 raft_consensus.cc:374] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.149550 12617 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.149502 12616 raft_consensus.cc:348] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.149734 12616 raft_consensus.cc:374] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.149822 12616 raft_consensus.cc:729] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.150121 12616 consensus_queue.cc:260] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.150179 12617 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.153362 12616 ts_tablet_manager.cc:1398] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240503 14:11:56.153725 12616 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.155653 12616 tablet_bootstrap.cc:654] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
W20240503 14:11:56.160459 12528 tablet.cc:2369] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 14:11:56.160459 12617 ts_tablet_manager.cc:1398] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20240503 14:11:56.174096 12617 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.177559 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.177836 12502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.178642 12427 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 0.
I20240503 14:11:56.180770 12616 tablet_bootstrap.cc:492] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.180964 12616 ts_tablet_manager.cc:1367] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.000s
I20240503 14:11:56.181008 12617 tablet_bootstrap.cc:654] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.181859 12616 raft_consensus.cc:348] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.182137 12616 raft_consensus.cc:374] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.182232 12616 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.182502 12616 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.183235 12616 ts_tablet_manager.cc:1398] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:11:56.183349 12617 tablet_bootstrap.cc:492] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.183518 12617 ts_tablet_manager.cc:1367] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.001s
I20240503 14:11:56.183585 12616 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.185055 12617 raft_consensus.cc:348] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.185278 12617 raft_consensus.cc:374] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.185403 12617 raft_consensus.cc:729] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.185789 12616 tablet_bootstrap.cc:654] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.185652 12617 consensus_queue.cc:260] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.186825 12618 tablet_bootstrap.cc:492] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.187001 12618 ts_tablet_manager.cc:1367] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.029s
I20240503 14:11:56.187433 12617 ts_tablet_manager.cc:1398] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:11:56.187762 12617 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.187933 12618 raft_consensus.cc:348] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.188194 12618 raft_consensus.cc:374] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.188297 12618 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.188565 12618 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.189191 12618 ts_tablet_manager.cc:1398] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:11:56.189507 12618 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.191372 12618 tablet_bootstrap.cc:654] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.193001 12542 leader_election.cc:302] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.193466 12623 raft_consensus.cc:2781] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20240503 14:11:56.193498 12542 leader_election.cc:341] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.193640 12623 raft_consensus.cc:482] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.193759 12623 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.196182 12623 raft_consensus.cc:504] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.196924 12623 leader_election.cc:288] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859)
I20240503 14:11:56.197464 12502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.197461 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.197773 12502 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.197778 12427 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.199443 12617 tablet_bootstrap.cc:654] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.201426 12427 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 1.
I20240503 14:11:56.202374 12542 leader_election.cc:302] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.202654 12616 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.201426 12502 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 1.
I20240503 14:11:56.202849 12616 ts_tablet_manager.cc:1367] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.005s
I20240503 14:11:56.202826 12623 raft_consensus.cc:2781] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.203744 12616 raft_consensus.cc:348] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.204061 12616 raft_consensus.cc:374] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.204149 12616 raft_consensus.cc:729] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.204455 12625 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.204499 12616 consensus_queue.cc:260] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.204628 12625 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.205731 12625 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.212764 12617 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.213053 12617 ts_tablet_manager.cc:1367] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.002s
I20240503 14:11:56.214686 12616 ts_tablet_manager.cc:1398] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.012s user 0.000s sys 0.003s
I20240503 14:11:56.215152 12616 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.217372 12617 raft_consensus.cc:348] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.219931 12502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.220013 12617 raft_consensus.cc:374] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.220206 12617 raft_consensus.cc:729] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.220212 12502 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 0.
I20240503 14:11:56.220914 12393 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.221244 12644 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.221364 12644 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.221508 12644 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.220592 12617 consensus_queue.cc:260] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.223888 12616 tablet_bootstrap.cc:654] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.223923 12618 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.224246 12618 ts_tablet_manager.cc:1367] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.035s user 0.009s sys 0.006s
I20240503 14:11:56.225286 12618 raft_consensus.cc:348] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.225670 12618 raft_consensus.cc:374] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.225607 12644 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.225795 12618 raft_consensus.cc:729] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.226600 12644 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.226682 12622 raft_consensus.cc:482] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.226857 12622 raft_consensus.cc:504] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.227110 12502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.227315 12502 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.228001 12622 leader_election.cc:288] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.229395 12644 raft_consensus.cc:482] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.229575 12644 raft_consensus.cc:504] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.230314 12644 leader_election.cc:288] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.230528 12502 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 1.
I20240503 14:11:56.226217 12618 consensus_queue.cc:260] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.234719 12618 ts_tablet_manager.cc:1398] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20240503 14:11:56.234843 12623 raft_consensus.cc:686] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:56.235237 12623 consensus_queue.cc:237] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.236830 12618 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: Bootstrap starting.
I20240503 14:11:56.239238 12618 tablet_bootstrap.cc:654] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.245218 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.245427 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.245826 12574 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 0.
I20240503 14:11:56.245244 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.247540 12391 leader_election.cc:302] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.247997 12644 raft_consensus.cc:2781] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.248145 12644 raft_consensus.cc:482] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.248265 12644 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.245631 12575 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.250049 12647 raft_consensus.cc:482] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.250274 12647 raft_consensus.cc:504] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.251904 12575 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 1.
I20240503 14:11:56.251914 12644 raft_consensus.cc:504] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.252919 12644 leader_election.cc:288] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.254033 12391 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.254452 12644 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.254702 12644 raft_consensus.cc:686] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.254845 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.255177 12575 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.255303 12616 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.255129 12644 consensus_queue.cc:237] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.255496 12616 ts_tablet_manager.cc:1367] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.009s
I20240503 14:11:56.257445 12618 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: No bootstrap required, opened a new log
I20240503 14:11:56.259235 12617 ts_tablet_manager.cc:1398] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.046s user 0.000s sys 0.006s
I20240503 14:11:56.258885 12647 leader_election.cc:288] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:56.266450 12618 ts_tablet_manager.cc:1367] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.003s
I20240503 14:11:56.266541 12617 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.267328 12618 raft_consensus.cc:348] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.267213 12324 catalog_manager.cc:5484] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 1 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.267580 12618 raft_consensus.cc:374] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.267707 12618 raft_consensus.cc:729] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.267982 12618 consensus_queue.cc:260] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.268548 12617 tablet_bootstrap.cc:654] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.268724 12618 ts_tablet_manager.cc:1398] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:11:56.260350 12625 raft_consensus.cc:482] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.270771 12625 raft_consensus.cc:504] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.263772 12502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.271456 12502 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 0.
I20240503 14:11:56.271541 12625 leader_election.cc:288] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.260054 12616 raft_consensus.cc:348] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.271888 12616 raft_consensus.cc:374] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.272020 12616 raft_consensus.cc:729] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.264278 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.272172 12501 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.272341 12616 consensus_queue.cc:260] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.273228 12616 ts_tablet_manager.cc:1398] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20240503 14:11:56.273365 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.273599 12616 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
I20240503 14:11:56.273597 12576 raft_consensus.cc:2454] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 0.
I20240503 14:11:56.274441 12391 leader_election.cc:302] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.274731 12625 raft_consensus.cc:2781] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.274825 12625 raft_consensus.cc:482] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.274921 12625 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.266717 12322 catalog_manager.cc:5484] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:11:56.264930 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.277107 12500 raft_consensus.cc:2454] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 0.
I20240503 14:11:56.259413 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.259045 12575 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 1.
W20240503 14:11:56.277812 12542 leader_election.cc:341] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.277874 12391 leader_election.cc:302] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.278228 12644 raft_consensus.cc:2781] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.279125 12501 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 1.
I20240503 14:11:56.280879 12542 leader_election.cc:302] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters: e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.277896 12625 raft_consensus.cc:504] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.281350 12647 raft_consensus.cc:2781] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.281494 12647 raft_consensus.cc:482] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.281606 12647 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.282212 12625 leader_election.cc:288] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.282733 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.283088 12575 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.283680 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.283747 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.286633 12501 raft_consensus.cc:2454] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 0.
I20240503 14:11:56.288872 12616 tablet_bootstrap.cc:654] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.290413 12644 raft_consensus.cc:686] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.290582 12647 raft_consensus.cc:504] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.290796 12644 consensus_queue.cc:237] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.291407 12647 leader_election.cc:288] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:56.292130 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
W20240503 14:11:56.292954 12542 leader_election.cc:341] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.293381 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.293699 12501 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.297389 12501 raft_consensus.cc:2454] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 1.
I20240503 14:11:56.292102 12575 raft_consensus.cc:2454] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 1.
I20240503 14:11:56.299554 12617 tablet_bootstrap.cc:492] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.299497 12391 leader_election.cc:302] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters: 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:11:56.299886 12655 raft_consensus.cc:2781] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.300079 12655 raft_consensus.cc:686] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.300302 12542 leader_election.cc:302] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters: e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.300482 12655 consensus_queue.cc:237] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.302269 12647 raft_consensus.cc:2781] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.302457 12647 raft_consensus.cc:686] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:56.302765 12647 consensus_queue.cc:237] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.303066 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.303329 12427 raft_consensus.cc:2454] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.299746 12617 ts_tablet_manager.cc:1367] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.010s
I20240503 14:11:56.304188 12468 leader_election.cc:302] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.304535 12622 raft_consensus.cc:2781] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.304701 12622 raft_consensus.cc:482] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.304829 12622 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.305307 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
W20240503 14:11:56.306156 12466 leader_election.cc:341] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.308336 12622 raft_consensus.cc:504] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.308691 12616 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.308900 12616 ts_tablet_manager.cc:1367] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.006s
I20240503 14:11:56.309204 12622 leader_election.cc:288] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.309772 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.310053 12427 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.309919 12616 raft_consensus.cc:348] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.310233 12616 raft_consensus.cc:374] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.310324 12616 raft_consensus.cc:729] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.310635 12616 consensus_queue.cc:260] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.310976 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.311270 12616 ts_tablet_manager.cc:1398] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:11:56.311724 12616 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: Bootstrap starting.
W20240503 14:11:56.311770 12466 leader_election.cc:341] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.311525 12324 catalog_manager.cc:5484] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 1 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.315613 12427 raft_consensus.cc:2454] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.316933 12468 leader_election.cc:302] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters: 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:56.316879 12617 raft_consensus.cc:348] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.318002 12622 raft_consensus.cc:2781] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.317937 12617 raft_consensus.cc:374] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.319110 12616 tablet_bootstrap.cc:654] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.323865 12617 raft_consensus.cc:729] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.324486 12617 consensus_queue.cc:260] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.325667 12617 ts_tablet_manager.cc:1398] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.021s user 0.000s sys 0.004s
I20240503 14:11:56.326395 12617 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.329383 12661 raft_consensus.cc:482] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.329675 12661 raft_consensus.cc:504] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.330781 12661 leader_election.cc:288] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.331339 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.333487 12427 raft_consensus.cc:2454] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.333818 12617 tablet_bootstrap.cc:654] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.331444 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.332850 12322 catalog_manager.cc:5484] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 0 to 1, leader changed from <none> to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 1 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.334353 12468 leader_election.cc:302] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
W20240503 14:11:56.334556 12466 leader_election.cc:341] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.332912 12622 raft_consensus.cc:686] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.335510 12622 consensus_queue.cc:237] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.331954 12324 catalog_manager.cc:5484] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:11:56.337393 12617 tablet_bootstrap.cc:492] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.337671 12617 ts_tablet_manager.cc:1367] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.003s
I20240503 14:11:56.338048 12661 raft_consensus.cc:2781] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.338198 12661 raft_consensus.cc:482] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.338300 12661 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.338838 12617 raft_consensus.cc:348] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.339529 12617 raft_consensus.cc:374] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.339668 12617 raft_consensus.cc:729] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.340449 12617 consensus_queue.cc:260] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.341099 12617 ts_tablet_manager.cc:1398] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:11:56.341585 12617 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: Bootstrap starting.
I20240503 14:11:56.343561 12661 raft_consensus.cc:504] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.344377 12616 tablet_bootstrap.cc:492] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: No bootstrap required, opened a new log
I20240503 14:11:56.345476 12617 tablet_bootstrap.cc:654] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: Neither blocks nor log segments found. Creating new log.
I20240503 14:11:56.345718 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.346151 12661 leader_election.cc:288] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.346684 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.347713 12427 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
W20240503 14:11:56.348172 12466 leader_election.cc:341] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:11:56.346654 12324 catalog_manager.cc:5484] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.348466 12616 ts_tablet_manager.cc:1367] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.009s
I20240503 14:11:56.349602 12616 raft_consensus.cc:348] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.349895 12616 raft_consensus.cc:374] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.350031 12616 raft_consensus.cc:729] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.350399 12616 consensus_queue.cc:260] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.350546 12427 raft_consensus.cc:2454] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.351110 12468 leader_election.cc:302] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters: 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:56.351923 12661 raft_consensus.cc:2781] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.352083 12661 raft_consensus.cc:686] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.352393 12661 consensus_queue.cc:237] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.355183 12622 raft_consensus.cc:482] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.355283 12616 ts_tablet_manager.cc:1398] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240503 14:11:56.357692 12617 tablet_bootstrap.cc:492] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: No bootstrap required, opened a new log
I20240503 14:11:56.357893 12617 ts_tablet_manager.cc:1367] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20240503 14:11:56.358723 12617 raft_consensus.cc:348] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.358917 12617 raft_consensus.cc:374] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:11:56.358997 12617 raft_consensus.cc:729] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Initialized, Role: FOLLOWER
I20240503 14:11:56.359270 12617 consensus_queue.cc:260] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.356113 12622 raft_consensus.cc:504] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.359899 12617 ts_tablet_manager.cc:1398] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:11:56.361055 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.361313 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.361372 12427 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.361533 12575 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.362000 12466 leader_election.cc:302] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:11:56.362259 12622 leader_election.cc:288] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.362335 12663 raft_consensus.cc:2781] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.362444 12663 raft_consensus.cc:482] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.362555 12663 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.365175 12663 raft_consensus.cc:504] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.365932 12663 leader_election.cc:288] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.366497 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.366497 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.366863 12575 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.366906 12427 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.368137 12324 catalog_manager.cc:5484] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.370150 12575 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.370150 12427 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.370797 12466 leader_election.cc:302] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.371096 12661 raft_consensus.cc:2781] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.371299 12661 raft_consensus.cc:686] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.371636 12661 consensus_queue.cc:237] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.374476 12324 catalog_manager.cc:5484] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.397614 12661 raft_consensus.cc:482] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.397835 12661 raft_consensus.cc:504] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.398631 12661 leader_election.cc:288] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.399186 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.399245 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.399453 12575 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.399462 12427 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 0.
I20240503 14:11:56.399917 12468 leader_election.cc:302] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.400213 12661 raft_consensus.cc:2781] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:11:56.400336 12661 raft_consensus.cc:482] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:11:56.400435 12661 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.402709 12661 raft_consensus.cc:504] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.403455 12661 leader_election.cc:288] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.404074 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.404322 12575 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.404523 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.404745 12427 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.408565 12575 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.408617 12427 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 1.
I20240503 14:11:56.409251 12468 leader_election.cc:302] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.409662 12661 raft_consensus.cc:2781] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:11:56.409824 12661 raft_consensus.cc:686] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.410214 12661 consensus_queue.cc:237] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.413266 12324 catalog_manager.cc:5484] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.462265 12575 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
mode: GRACEFUL
new_leader_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:56274
I20240503 14:11:56.462575 12575 raft_consensus.cc:595] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Received request to transfer leadership to TS e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.472445 12501 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:33240
I20240503 14:11:56.472669 12501 raft_consensus.cc:595] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Received request to transfer leadership to TS e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.479457 12427 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:46804
I20240503 14:11:56.479701 12427 raft_consensus.cc:595] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:11:56.484170 12575 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:56274
I20240503 14:11:56.484416 12575 raft_consensus.cc:595] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:11:56.486543 12501 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:33240
I20240503 14:11:56.486764 12501 raft_consensus.cc:595] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Received request to transfer leadership to TS 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:56.521476 12655 raft_consensus.cc:482] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.521731 12655 raft_consensus.cc:504] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.522651 12655 leader_election.cc:288] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.523243 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" is_pre_election: true
I20240503 14:11:56.523245 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.523592 12501 raft_consensus.cc:2379] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e12cd3e1edfd4acd81d026936404aa05 in current term 1: Already voted for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in this term.
I20240503 14:11:56.523981 12393 leader_election.cc:302] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e12cd3e1edfd4acd81d026936404aa05; no voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:56.524350 12655 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.526196 12647 raft_consensus.cc:482] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.526451 12647 raft_consensus.cc:504] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.526770 12655 raft_consensus.cc:2726] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:11:56.527212 12647 leader_election.cc:288] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:56.528385 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.528450 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.528689 12427 raft_consensus.cc:2379] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in current term 1: Already voted for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in this term.
I20240503 14:11:56.529210 12542 leader_election.cc:302] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8; no voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.529528 12647 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.531546 12647 raft_consensus.cc:2726] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:11:56.579978 12647 raft_consensus.cc:482] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:11:56.580201 12647 raft_consensus.cc:504] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.580844 12647 leader_election.cc:288] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:56.581553 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" is_pre_election: true
I20240503 14:11:56.581553 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e12cd3e1edfd4acd81d026936404aa05" is_pre_election: true
I20240503 14:11:56.581938 12427 raft_consensus.cc:2379] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in current term 1: Already voted for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in this term.
I20240503 14:11:56.582427 12542 leader_election.cc:302] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8; no voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05
I20240503 14:11:56.582777 12647 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.584877 12647 raft_consensus.cc:2726] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:11:56.641590 12647 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.647867 12623 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.650964 12647 raft_consensus.cc:979] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: : Instructing follower e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:11:56.651149 12647 raft_consensus.cc:1067] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Signalling peer e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:11:56.652104 12427 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:46796
I20240503 14:11:56.652367 12427 raft_consensus.cc:482] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:56.652504 12427 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.654506 12427 raft_consensus.cc:504] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.655241 12427 leader_election.cc:288] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.655736 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.655763 12501 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.655977 12501 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.655984 12575 raft_consensus.cc:3032] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:56.656112 12575 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:56.656425 12575 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.657095 12575 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.659006 12501 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:11:56.659533 12393 leader_election.cc:302] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.659693 12575 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:11:56.660032 12655 raft_consensus.cc:2781] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:56.660225 12655 raft_consensus.cc:686] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.660564 12655 consensus_queue.cc:237] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.662954 12322 catalog_manager.cc:5484] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 1 to 2, leader changed from 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131) to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.677325 12655 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.682080 12644 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.684994 12625 raft_consensus.cc:979] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:11:56.685218 12644 raft_consensus.cc:1067] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:11:56.685794 12501 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33224
I20240503 14:11:56.686051 12501 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:56.686195 12501 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.689018 12501 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.689782 12501 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.690296 12427 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.690539 12427 raft_consensus.cc:3032] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:56.690660 12427 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.690577 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.690817 12575 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.690960 12427 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.691318 12427 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.693341 12575 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:11:56.693483 12427 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:11:56.693749 12466 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:11:56.694065 12661 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:56.694252 12661 raft_consensus.cc:686] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.694504 12661 consensus_queue.cc:237] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.696597 12322 catalog_manager.cc:5484] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 1 to 2, leader changed from e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.732302 12661 consensus_queue.cc:1035] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.736567 12661 consensus_queue.cc:1035] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.739622 12644 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.744297 12681 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.761710 12661 consensus_queue.cc:1035] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.766520 12661 consensus_queue.cc:1035] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.815075 12681 consensus_queue.cc:1035] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.819057 12501 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:11:56.822573 12655 consensus_queue.cc:1035] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.839318 12661 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.842620 12663 raft_consensus.cc:979] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:11:56.843084 12663 raft_consensus.cc:1067] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Signalling peer e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:11:56.844911 12622 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.844889 12647 consensus_queue.cc:1035] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.845208 12426 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:46800
I20240503 14:11:56.845419 12426 raft_consensus.cc:482] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:56.845571 12426 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.848685 12426 raft_consensus.cc:504] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.849925 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.850234 12500 raft_consensus.cc:3032] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:56.850342 12500 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.850638 12500 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.850905 12500 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.851011 12426 leader_election.cc:288] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.853201 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.853832 12500 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:11:56.853878 12576 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.854312 12393 leader_election.cc:302] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.854609 12655 raft_consensus.cc:2781] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:56.854765 12655 raft_consensus.cc:686] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:56.855034 12655 consensus_queue.cc:237] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.855556 12622 consensus_queue.cc:1035] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.856978 12576 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:11:56.860528 12323 catalog_manager.cc:5484] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 1 to 2, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.861101 12647 raft_consensus.cc:979] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:11:56.861255 12647 raft_consensus.cc:1067] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:11:56.861850 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33210
I20240503 14:11:56.862107 12500 raft_consensus.cc:482] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:56.862237 12500 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.863176 12661 consensus_queue.cc:1035] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.865139 12500 raft_consensus.cc:504] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.866683 12575 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:11:56.866919 12575 raft_consensus.cc:3032] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:56.865927 12500 leader_election.cc:288] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:11:56.867012 12575 raft_consensus.cc:729] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:56.867571 12575 consensus_queue.cc:260] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.867794 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7967ddb7aa5840d9a086219e31f810aa" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.867852 12643 consensus_queue.cc:1035] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:56.868019 12426 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.868391 12575 raft_consensus.cc:3037] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.869320 12622 raft_consensus.cc:979] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:56.869472 12622 raft_consensus.cc:1067] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Signalling peer 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:56.870245 12574 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:56272
I20240503 14:11:56.870424 12574 raft_consensus.cc:482] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:56.870535 12574 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.871183 12426 raft_consensus.cc:2454] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:11:56.871628 12468 leader_election.cc:302] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.872181 12661 raft_consensus.cc:2781] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:56.872308 12575 raft_consensus.cc:2454] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:11:56.872334 12661 raft_consensus.cc:686] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.872670 12661 consensus_queue.cc:237] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.873327 12574 raft_consensus.cc:504] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.874040 12574 leader_election.cc:288] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:56.874629 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:56.874856 12500 raft_consensus.cc:3032] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:56.874926 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b1eb7d2b36b42fb800e1b0d4a14c33f" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:56.875617 12500 raft_consensus.cc:729] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:56.876003 12500 consensus_queue.cc:260] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.875617 12426 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.876438 12500 raft_consensus.cc:3037] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:56.876372 12324 catalog_manager.cc:5484] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 1 to 2, leader changed from 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:11:56.879205 12426 raft_consensus.cc:2454] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:11:56.879645 12500 raft_consensus.cc:2454] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:11:56.879760 12542 leader_election.cc:302] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:56.880069 12643 raft_consensus.cc:2781] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:56.880254 12643 raft_consensus.cc:686] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:56.880560 12643 consensus_queue.cc:237] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:56.883339 12324 catalog_manager.cc:5484] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 1 to 2, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:11:57.061074 12574 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.061846 12681 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.064095 12500 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.064900 12625 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.076126 12426 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.076799 12661 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.080145 12574 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.080763 12692 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.276854 12574 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.277454 12625 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.280790 12500 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.281437 12681 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.301635 12574 raft_consensus.cc:1261] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.302438 12663 consensus_queue.cc:1035] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.305891 12426 raft_consensus.cc:1261] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.306900 12692 consensus_queue.cc:1035] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:11:57.495276 12500 raft_consensus.cc:1261] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.495939 12643 consensus_queue.cc:1035] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:57.497212 12426 raft_consensus.cc:1261] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:11:57.497772 12695 consensus_queue.cc:1035] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:11:59.498353 12294 auto_leader_rebalancer-test.cc:261] The leader distribution is
I20240503 14:11:59.498780 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:11:59.512763 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:11:59.513062 12500 raft_consensus.cc:595] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Received request to transfer leadership to TS 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:59.519544 12426 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
mode: GRACEFUL
new_leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:46818
I20240503 14:11:59.519773 12426 raft_consensus.cc:595] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Received request to transfer leadership to TS 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:11:59.520340 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 14:11:59.520690 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:11:59.571823 12700 raft_consensus.cc:979] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:59.572052 12692 raft_consensus.cc:1067] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Signalling peer 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:59.572716 12574 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:56272
I20240503 14:11:59.572932 12574 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:59.573038 12574 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:11:59.577610 12574 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.578344 12574 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 3 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:59.578972 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:59.578979 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:59.579214 12426 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:11:59.579221 12500 raft_consensus.cc:3032] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:11:59.579314 12500 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:11:59.579645 12500 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.579973 12500 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:11:59.582032 12426 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 3.
I20240503 14:11:59.582222 12500 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 3.
I20240503 14:11:59.582571 12542 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:11:59.582937 12695 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:11:59.583400 12695 raft_consensus.cc:686] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:59.583709 12695 consensus_queue.cc:237] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.586807 12322 catalog_manager.cc:5484] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 2 to 3, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 3 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:11:59.914971 12707 raft_consensus.cc:979] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: : Instructing follower 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:59.915148 12707 raft_consensus.cc:1067] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Signalling peer 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:11:59.915932 12574 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:56256
I20240503 14:11:59.916147 12574 raft_consensus.cc:482] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:11:59.916283 12574 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:59.918401 12574 raft_consensus.cc:504] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.919071 12574 leader_election.cc:288] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:11:59.919677 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:11:59.919718 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:11:59.919981 12500 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:59.920006 12426 raft_consensus.cc:3032] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:11:59.920125 12426 raft_consensus.cc:729] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:11:59.920440 12426 consensus_queue.cc:260] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.920871 12426 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:11:59.923113 12500 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:11:59.923633 12426 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:11:59.923687 12542 leader_election.cc:302] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:11:59.924026 12695 raft_consensus.cc:2781] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:11:59.924738 12695 raft_consensus.cc:686] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:11:59.925034 12695 consensus_queue.cc:237] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:11:59.927965 12322 catalog_manager.cc:5484] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 1 to 2, leader changed from e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129) to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:00.034567 12426 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:00.035221 12695 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:00.039091 12500 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:00.039841 12701 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:00.312453 12426 raft_consensus.cc:1261] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:00.313176 12701 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:00.317011 12500 raft_consensus.cc:1261] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:00.317677 12695 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:00.521214 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:00.522970 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:00.523201 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:01.523589 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:01.525357 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:01.525547 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:02.526024 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:02.527659 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:02.527907 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:03.528403 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:03.530408 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:03.530664 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:04.531129 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:04.532846 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:04.533077 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:05.533510 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:05.535521 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:05.535818 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:06.536305 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:06.538043 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:06.538275 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:07.538659 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:07.540313 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:07.540516 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:08.541029 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:08.542855 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:08.543089 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:09.553151 12294 auto_leader_rebalancer-test.cc:280] The leader distribution is
I20240503 14:12:09.554796 12426 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:46804
I20240503 14:12:09.555524 12426 raft_consensus.cc:595] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:12:09.557317 12574 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:56274
I20240503 14:12:09.557518 12574 raft_consensus.cc:595] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:12:09.559283 12426 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:46804
I20240503 14:12:09.559475 12426 raft_consensus.cc:595] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:12:09.561204 12426 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:46804
I20240503 14:12:09.561394 12426 raft_consensus.cc:595] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:12:09.563153 12574 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
mode: GRACEFUL
new_leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:56274
I20240503 14:12:09.563329 12574 raft_consensus.cc:595] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 LEADER]: Received request to transfer leadership to TS 1fdcfa73b7c64888aecf3fe68513f1a4
I20240503 14:12:09.720023 12707 raft_consensus.cc:979] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.720330 12717 raft_consensus.cc:1067] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.721135 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33224
I20240503 14:12:09.721391 12500 raft_consensus.cc:482] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:09.721529 12500 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.724740 12500 raft_consensus.cc:504] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.725555 12500 leader_election.cc:288] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:09.726476 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:09.726727 12574 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.727996 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:09.728329 12426 raft_consensus.cc:3032] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:09.728427 12426 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:09.728730 12426 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.729120 12426 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.729586 12574 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.730520 12466 leader_election.cc:302] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:12:09.730962 12692 raft_consensus.cc:2781] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:09.731407 12692 raft_consensus.cc:686] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:09.731925 12707 raft_consensus.cc:979] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.731990 12426 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.732137 12717 raft_consensus.cc:1067] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.732064 12692 consensus_queue.cc:237] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.732870 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33224
I20240503 14:12:09.733093 12500 raft_consensus.cc:482] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:09.733304 12500 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.735906 12500 raft_consensus.cc:504] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.735816 12323 catalog_manager.cc:5484] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 2 to 3, leader changed from e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 3 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:09.736795 12500 leader_election.cc:288] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:09.737030 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:09.737030 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:09.737272 12426 raft_consensus.cc:3032] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:09.737269 12574 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.737393 12426 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:09.737694 12426 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.738054 12426 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.740191 12426 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.740592 12468 leader_election.cc:302] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:09.740679 12574 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.740911 12692 raft_consensus.cc:2781] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:09.741071 12692 raft_consensus.cc:686] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:09.741389 12692 consensus_queue.cc:237] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.751361 12323 catalog_manager.cc:5484] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 2 to 3, leader changed from e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 3 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:09.769066 12695 raft_consensus.cc:979] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.769232 12695 raft_consensus.cc:1067] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.769853 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33210
I20240503 14:12:09.770078 12500 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:09.770210 12500 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:09.772115 12500 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.772707 12500 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 4 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:09.773658 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:09.773664 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:09.773864 12426 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:09.773938 12574 raft_consensus.cc:3032] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 14:12:09.774056 12574 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:12:09.774329 12574 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.774647 12574 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:09.776057 12426 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 4.
I20240503 14:12:09.776453 12468 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:09.776710 12692 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:12:09.776767 12574 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 4.
I20240503 14:12:09.776895 12692 raft_consensus.cc:686] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:09.777154 12692 consensus_queue.cc:237] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.779712 12323 catalog_manager.cc:5484] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 3 to 4, leader changed from 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 4 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:09.892052 12725 raft_consensus.cc:979] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.892216 12725 raft_consensus.cc:1067] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.892940 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33210
I20240503 14:12:09.893154 12500 raft_consensus.cc:482] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:09.893286 12500 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.895339 12500 raft_consensus.cc:504] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.895944 12500 leader_election.cc:288] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:09.896471 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:09.896466 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deef35a04f044b9b881b35e3b42b38c9" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:09.896734 12426 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.896757 12574 raft_consensus.cc:3032] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:09.896845 12574 raft_consensus.cc:729] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:12:09.897136 12574 consensus_queue.cc:260] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.897552 12574 raft_consensus.cc:3037] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:09.899822 12426 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.900259 12574 raft_consensus.cc:2454] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 3.
I20240503 14:12:09.900310 12468 leader_election.cc:302] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:09.900697 12692 raft_consensus.cc:2781] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:09.900852 12692 raft_consensus.cc:686] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:09.901170 12692 consensus_queue.cc:237] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.903798 12323 catalog_manager.cc:5484] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 2 to 3, leader changed from 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 3 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:09.959039 12707 raft_consensus.cc:979] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: : Instructing follower 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.959241 12707 raft_consensus.cc:1067] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Signalling peer 1fdcfa73b7c64888aecf3fe68513f1a4 to start an election
I20240503 14:12:09.959915 12500 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
from {username='slave'} at 127.0.0.1:33224
I20240503 14:12:09.960125 12500 raft_consensus.cc:482] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:09.960253 12500 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:09.962792 12500 raft_consensus.cc:504] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.963503 12500 leader_election.cc:288] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:09.964031 12574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:09.964032 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "955de46327ff4b41813ba3250c5dcc6d" candidate_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:09.964322 12574 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:09.964344 12426 raft_consensus.cc:3032] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:09.964427 12426 raft_consensus.cc:729] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:09.964715 12426 consensus_queue.cc:260] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.965131 12426 raft_consensus.cc:3037] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:09.967438 12574 raft_consensus.cc:2454] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:12:09.967912 12426 raft_consensus.cc:2454] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fdcfa73b7c64888aecf3fe68513f1a4 in term 2.
I20240503 14:12:09.967950 12466 leader_election.cc:302] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:12:09.968317 12692 raft_consensus.cc:2781] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:09.968513 12692 raft_consensus.cc:686] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Becoming Leader. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:09.968792 12692 consensus_queue.cc:237] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:09.971644 12323 catalog_manager.cc:5484] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 reported cstate change: term changed from 1 to 2, leader changed from e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129) to 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:10.222524 12426 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.223120 12692 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.227639 12574 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.228425 12718 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.242641 12426 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.243238 12692 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.248203 12574 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.248836 12736 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.264968 12574 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:10.265588 12736 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:10.269879 12426 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:10.270512 12736 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:10.409822 12574 raft_consensus.cc:1261] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.410429 12736 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.413667 12426 raft_consensus.cc:1261] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:10.414337 12692 consensus_queue.cc:1035] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:10.449707 12574 raft_consensus.cc:1261] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:10.450282 12692 consensus_queue.cc:1035] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:10.454185 12426 raft_consensus.cc:1261] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 1fdcfa73b7c64888aecf3fe68513f1a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:10.454696 12736 consensus_queue.cc:1035] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:12.577961 12294 auto_leader_rebalancer-test.cc:295] The leader distribution is
I20240503 14:12:12.578287 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:12.581251 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:12:12.581526 12500 raft_consensus.cc:595] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 LEADER]: Received request to transfer leadership to TS e12cd3e1edfd4acd81d026936404aa05
I20240503 14:12:12.582633 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:12:12.582841 12500 raft_consensus.cc:595] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Received request to transfer leadership to TS 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:12:12.583786 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:12:12.583974 12500 raft_consensus.cc:595] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Received request to transfer leadership to TS 2b85be8c8e8e4e3c97a5e19f886991f8
I20240503 14:12:12.585048 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:12:12.585223 12500 raft_consensus.cc:595] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Received request to transfer leadership to TS e12cd3e1edfd4acd81d026936404aa05
I20240503 14:12:12.586135 12500 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
mode: GRACEFUL
new_leader_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:33246
I20240503 14:12:12.586302 12500 raft_consensus.cc:595] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Received request to transfer leadership to TS e12cd3e1edfd4acd81d026936404aa05
I20240503 14:12:12.586707 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 5
I20240503 14:12:12.586941 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:12.668069 12692 raft_consensus.cc:979] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.668244 12692 raft_consensus.cc:1067] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Signalling peer e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.668898 12426 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:46800
I20240503 14:12:12.669116 12426 raft_consensus.cc:482] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:12.669240 12426 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.671219 12426 raft_consensus.cc:504] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.672127 12426 leader_election.cc:288] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 4 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:12.672600 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:12:12.672794 12500 raft_consensus.cc:3032] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 14:12:12.672715 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53da463a00c4dc290e69699630b20e3" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:12.672874 12500 raft_consensus.cc:729] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:12.672957 12576 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.673156 12500 consensus_queue.cc:260] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.673450 12500 raft_consensus.cc:3037] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.675345 12576 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 4.
I20240503 14:12:12.675439 12500 raft_consensus.cc:2454] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 4.
I20240503 14:12:12.675853 12391 leader_election.cc:302] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:12.676533 12746 raft_consensus.cc:2781] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:12:12.676918 12746 raft_consensus.cc:686] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 4 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:12.677198 12746 consensus_queue.cc:237] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.679986 12322 catalog_manager.cc:5484] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 3 to 4, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 4 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:12.689831 12745 raft_consensus.cc:979] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.690023 12745 raft_consensus.cc:1067] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 LEADER]: Signalling peer e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.690645 12426 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:46800
I20240503 14:12:12.690852 12426 raft_consensus.cc:482] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:12.690975 12426 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Advancing to term 5
I20240503 14:12:12.692891 12426 raft_consensus.cc:504] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.693522 12426 leader_election.cc:288] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 5 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:12.694032 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:12.694029 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17467865e2f34ddab23c7ca92e20a8fb" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:12:12.694272 12576 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Advancing to term 5
I20240503 14:12:12.694320 12500 raft_consensus.cc:3032] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 LEADER]: Stepping down as leader of term 4
I20240503 14:12:12.694408 12500 raft_consensus.cc:729] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:12.694686 12500 consensus_queue.cc:260] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.694998 12500 raft_consensus.cc:3037] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Advancing to term 5
I20240503 14:12:12.696897 12576 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 5.
I20240503 14:12:12.697270 12500 raft_consensus.cc:2454] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 5.
I20240503 14:12:12.697324 12391 leader_election.cc:302] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:12.697646 12746 raft_consensus.cc:2781] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 5 FOLLOWER]: Leader election won for term 5
I20240503 14:12:12.697837 12746 raft_consensus.cc:686] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 5 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:12.698133 12746 consensus_queue.cc:237] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.700755 12322 catalog_manager.cc:5484] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 4 to 5, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 5 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:12.750036 12745 raft_consensus.cc:979] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.750221 12745 raft_consensus.cc:1067] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Signalling peer e12cd3e1edfd4acd81d026936404aa05 to start an election
I20240503 14:12:12.750857 12426 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab"
dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
from {username='slave'} at 127.0.0.1:46800
I20240503 14:12:12.751046 12426 raft_consensus.cc:482] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:12.751174 12426 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:12.753090 12426 raft_consensus.cc:504] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.753755 12426 leader_election.cc:288] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131:40757)
I20240503 14:12:12.754314 12576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
I20240503 14:12:12.754315 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2d56e5f67114535a065e46acb45aaab" candidate_uuid: "e12cd3e1edfd4acd81d026936404aa05" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:12:12.754529 12576 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:12.754559 12500 raft_consensus.cc:3032] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:12.754632 12500 raft_consensus.cc:729] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:12.754916 12500 consensus_queue.cc:260] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.755221 12500 raft_consensus.cc:3037] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:12.756680 12576 raft_consensus.cc:2454] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:12:12.757091 12391 leader_election.cc:302] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:12.757359 12500 raft_consensus.cc:2454] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e12cd3e1edfd4acd81d026936404aa05 in term 2.
I20240503 14:12:12.757431 12746 raft_consensus.cc:2781] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:12.757586 12746 raft_consensus.cc:686] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Becoming Leader. State: Replica: e12cd3e1edfd4acd81d026936404aa05, State: Running, Role: LEADER
I20240503 14:12:12.757872 12746 consensus_queue.cc:237] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.760502 12322 catalog_manager.cc:5484] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 reported cstate change: term changed from 1 to 2, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "e12cd3e1edfd4acd81d026936404aa05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:12.980010 12692 raft_consensus.cc:979] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:12:12.980235 12692 raft_consensus.cc:1067] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Signalling peer 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:12:12.981009 12576 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "802e1d937888433d950994c73187f1b1"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:56272
I20240503 14:12:12.981283 12576 raft_consensus.cc:482] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:12.981423 12576 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.984372 12576 raft_consensus.cc:504] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.985380 12576 leader_election.cc:288] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 4 election: Requested vote from peers 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613), e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859)
I20240503 14:12:12.985752 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:12:12.986048 12500 raft_consensus.cc:3032] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 14:12:12.986162 12500 raft_consensus.cc:729] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:12.986128 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "802e1d937888433d950994c73187f1b1" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:12.986321 12426 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.986490 12500 consensus_queue.cc:260] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.986863 12500 raft_consensus.cc:3037] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:12.989415 12426 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 4.
I20240503 14:12:12.989600 12500 raft_consensus.cc:2454] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 4.
I20240503 14:12:12.989970 12542 leader_election.cc:302] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fdcfa73b7c64888aecf3fe68513f1a4, 2b85be8c8e8e4e3c97a5e19f886991f8; no voters:
I20240503 14:12:12.990317 12744 raft_consensus.cc:2781] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:12:12.990803 12744 raft_consensus.cc:686] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:12:12.991133 12744 consensus_queue.cc:237] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:12.994083 12322 catalog_manager.cc:5484] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 3 to 4, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 4 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:13.061343 12745 raft_consensus.cc:979] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: : Instructing follower 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:12:13.061535 12745 raft_consensus.cc:1067] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Signalling peer 2b85be8c8e8e4e3c97a5e19f886991f8 to start an election
I20240503 14:12:13.062237 12576 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17"
dest_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8"
from {username='slave'} at 127.0.0.1:56272
I20240503 14:12:13.062451 12576 raft_consensus.cc:482] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:13.062556 12576 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:13.064539 12576 raft_consensus.cc:504] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:13.065296 12576 leader_election.cc:288] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Requested vote from peers e12cd3e1edfd4acd81d026936404aa05 (127.12.1.129:43859), 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130:33613)
I20240503 14:12:13.065822 12426 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e12cd3e1edfd4acd81d026936404aa05"
I20240503 14:12:13.066010 12500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c11ce2d2844ce68ba9c67ba58cac17" candidate_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4"
I20240503 14:12:13.066104 12426 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:13.066174 12500 raft_consensus.cc:3032] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:13.066269 12500 raft_consensus.cc:729] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1fdcfa73b7c64888aecf3fe68513f1a4, State: Running, Role: LEADER
I20240503 14:12:13.066586 12500 consensus_queue.cc:260] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:13.066998 12500 raft_consensus.cc:3037] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:13.069047 12426 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:12:13.069537 12542 leader_election.cc:302] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b85be8c8e8e4e3c97a5e19f886991f8, e12cd3e1edfd4acd81d026936404aa05; no voters:
I20240503 14:12:13.069622 12500 raft_consensus.cc:2454] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b85be8c8e8e4e3c97a5e19f886991f8 in term 2.
I20240503 14:12:13.069849 12744 raft_consensus.cc:2781] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:13.070055 12744 raft_consensus.cc:686] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Becoming Leader. State: Replica: 2b85be8c8e8e4e3c97a5e19f886991f8, State: Running, Role: LEADER
I20240503 14:12:13.070803 12744 consensus_queue.cc:237] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } }
I20240503 14:12:13.073614 12322 catalog_manager.cc:5484] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 reported cstate change: term changed from 1 to 2, leader changed from 1fdcfa73b7c64888aecf3fe68513f1a4 (127.12.1.130) to 2b85be8c8e8e4e3c97a5e19f886991f8 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:13.198998 12500 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:13.199764 12746 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:13.204708 12576 raft_consensus.cc:1261] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:13.205457 12746 consensus_queue.cc:1035] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:13.212069 12576 raft_consensus.cc:1261] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:13.212611 12746 consensus_queue.cc:1035] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:13.217715 12500 raft_consensus.cc:1261] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:13.218322 12747 consensus_queue.cc:1035] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:13.270120 12576 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 5 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 14:12:13.270779 12747 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b85be8c8e8e4e3c97a5e19f886991f8" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 40757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 14:12:13.274353 12500 raft_consensus.cc:1261] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 5 FOLLOWER]: Refusing update from remote peer e12cd3e1edfd4acd81d026936404aa05: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20240503 14:12:13.274927 12747 consensus_queue.cc:1035] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240503 14:12:13.501549 12500 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:13.502288 12755 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:13.505880 12426 raft_consensus.cc:1261] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:13.506482 12755 consensus_queue.cc:1035] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:13.523351 12426 raft_consensus.cc:1261] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:13.523969 12755 consensus_queue.cc:1035] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e12cd3e1edfd4acd81d026936404aa05" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 43859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:13.529388 12500 raft_consensus.cc:1261] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Refusing update from remote peer 2b85be8c8e8e4e3c97a5e19f886991f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:13.530089 12772 consensus_queue.cc:1035] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fdcfa73b7c64888aecf3fe68513f1a4" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:13.587383 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:13.588985 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:13.589211 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:14.589656 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:14.591287 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:14.591506 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:15.591925 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:15.593565 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:15.593804 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:16.594314 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:16.596323 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:16.596561 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:17.597101 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:17.599123 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:17.599386 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:18.599849 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:18.601727 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:18.601922 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:19.602432 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:19.604394 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:19.604635 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:20.605146 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:20.607602 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:20.607851 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:21.608239 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:21.609861 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:21.610112 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:22.620847 12294 auto_leader_rebalancer-test.cc:306] The leader distribution is
I20240503 14:12:22.621165 12294 tablet_server.cc:178] TabletServer@127.12.1.129:0 shutting down...
I20240503 14:12:22.631810 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:22.632148 12294 tablet_replica.cc:330] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.632596 12294 raft_consensus.cc:2229] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.633049 12294 raft_consensus.cc:2258] T a2d56e5f67114535a065e46acb45aaab P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.634481 12294 tablet_replica.cc:330] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.634655 12294 raft_consensus.cc:2229] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 5 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.634934 12294 raft_consensus.cc:2258] T 17467865e2f34ddab23c7ca92e20a8fb P e12cd3e1edfd4acd81d026936404aa05 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.635457 12294 tablet_replica.cc:330] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.635596 12294 raft_consensus.cc:2229] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.635751 12294 raft_consensus.cc:2258] T 955de46327ff4b41813ba3250c5dcc6d P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.636188 12294 tablet_replica.cc:330] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.636343 12294 raft_consensus.cc:2229] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.636483 12294 raft_consensus.cc:2258] T 802e1d937888433d950994c73187f1b1 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.636931 12294 tablet_replica.cc:330] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.637049 12294 raft_consensus.cc:2229] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.637200 12294 raft_consensus.cc:2258] T 7967ddb7aa5840d9a086219e31f810aa P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.637609 12294 tablet_replica.cc:330] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.637737 12294 raft_consensus.cc:2229] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.637877 12294 raft_consensus.cc:2258] T deef35a04f044b9b881b35e3b42b38c9 P e12cd3e1edfd4acd81d026936404aa05 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.638331 12294 tablet_replica.cc:330] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.638454 12294 raft_consensus.cc:2229] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 4 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.638716 12294 raft_consensus.cc:2258] T c53da463a00c4dc290e69699630b20e3 P e12cd3e1edfd4acd81d026936404aa05 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.639124 12294 tablet_replica.cc:330] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.639261 12294 raft_consensus.cc:2229] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.639398 12294 raft_consensus.cc:2258] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.639796 12294 tablet_replica.cc:330] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05: stopping tablet replica
I20240503 14:12:22.639904 12294 raft_consensus.cc:2229] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.640058 12294 raft_consensus.cc:2258] T 52c11ce2d2844ce68ba9c67ba58cac17 P e12cd3e1edfd4acd81d026936404aa05 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.657491 12294 tablet_server.cc:194] TabletServer@127.12.1.129:0 shutdown complete.
I20240503 14:12:22.665307 12294 tablet_server.cc:178] TabletServer@127.12.1.130:0 shutting down...
I20240503 14:12:22.673802 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:22.674167 12294 tablet_replica.cc:330] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.674365 12294 raft_consensus.cc:2229] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.674584 12294 raft_consensus.cc:2258] T 802e1d937888433d950994c73187f1b1 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.675186 12294 tablet_replica.cc:330] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.675361 12294 raft_consensus.cc:2229] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.675669 12294 raft_consensus.cc:2258] T 955de46327ff4b41813ba3250c5dcc6d P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.676187 12294 tablet_replica.cc:330] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.676424 12294 raft_consensus.cc:2229] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.676623 12294 raft_consensus.cc:2258] T 17467865e2f34ddab23c7ca92e20a8fb P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.677084 12294 tablet_replica.cc:330] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.677238 12294 raft_consensus.cc:2229] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.677390 12294 raft_consensus.cc:2258] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.677837 12294 tablet_replica.cc:330] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.677999 12294 raft_consensus.cc:2229] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.678156 12294 raft_consensus.cc:2258] T 52c11ce2d2844ce68ba9c67ba58cac17 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.678601 12294 tablet_replica.cc:330] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.678746 12294 raft_consensus.cc:2229] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.679010 12294 raft_consensus.cc:2258] T 7967ddb7aa5840d9a086219e31f810aa P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.679445 12294 tablet_replica.cc:330] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.679571 12294 raft_consensus.cc:2229] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.679710 12294 raft_consensus.cc:2258] T c53da463a00c4dc290e69699630b20e3 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.680096 12294 tablet_replica.cc:330] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.680231 12294 raft_consensus.cc:2229] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.680469 12294 raft_consensus.cc:2258] T deef35a04f044b9b881b35e3b42b38c9 P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.680864 12294 tablet_replica.cc:330] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4: stopping tablet replica
I20240503 14:12:22.680984 12294 raft_consensus.cc:2229] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.681123 12294 raft_consensus.cc:2258] T a2d56e5f67114535a065e46acb45aaab P 1fdcfa73b7c64888aecf3fe68513f1a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.696501 12294 tablet_server.cc:194] TabletServer@127.12.1.130:0 shutdown complete.
I20240503 14:12:22.700724 12294 tablet_server.cc:178] TabletServer@127.12.1.131:0 shutting down...
I20240503 14:12:22.708833 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:22.709136 12294 tablet_replica.cc:330] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.709326 12294 raft_consensus.cc:2229] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.709520 12294 raft_consensus.cc:2258] T a2d56e5f67114535a065e46acb45aaab P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.710152 12294 tablet_replica.cc:330] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.710311 12294 raft_consensus.cc:2229] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.710582 12294 raft_consensus.cc:2258] T 5b1eb7d2b36b42fb800e1b0d4a14c33f P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.711062 12294 tablet_replica.cc:330] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.711190 12294 raft_consensus.cc:2229] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.711416 12294 raft_consensus.cc:2258] T 52c11ce2d2844ce68ba9c67ba58cac17 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.711819 12294 tablet_replica.cc:330] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.711958 12294 raft_consensus.cc:2229] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.712162 12294 raft_consensus.cc:2258] T 802e1d937888433d950994c73187f1b1 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.712560 12294 tablet_replica.cc:330] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.712672 12294 raft_consensus.cc:2229] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.712802 12294 raft_consensus.cc:2258] T 17467865e2f34ddab23c7ca92e20a8fb P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.713177 12294 tablet_replica.cc:330] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.713299 12294 raft_consensus.cc:2229] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.713411 12294 raft_consensus.cc:2258] T 955de46327ff4b41813ba3250c5dcc6d P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.713776 12294 tablet_replica.cc:330] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.713889 12294 raft_consensus.cc:2229] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.714057 12294 raft_consensus.cc:2258] T deef35a04f044b9b881b35e3b42b38c9 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.714442 12294 tablet_replica.cc:330] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.714565 12294 raft_consensus.cc:2229] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.714674 12294 raft_consensus.cc:2258] T c53da463a00c4dc290e69699630b20e3 P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.715044 12294 tablet_replica.cc:330] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8: stopping tablet replica
I20240503 14:12:22.715144 12294 raft_consensus.cc:2229] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:22.715266 12294 raft_consensus.cc:2258] T 7967ddb7aa5840d9a086219e31f810aa P 2b85be8c8e8e4e3c97a5e19f886991f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.730327 12294 tablet_server.cc:194] TabletServer@127.12.1.131:0 shutdown complete.
I20240503 14:12:22.734607 12294 master.cc:537] Master@127.12.1.190:39533 shutting down...
I20240503 14:12:22.742393 12294 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 1 LEADER]: Raft consensus shutting down.
I20240503 14:12:22.742671 12294 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:22.742815 12294 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a18f19e2642409583c75b5ad23f59d3: stopping tablet replica
I20240503 14:12:22.756117 12294 master.cc:552] Master@127.12.1.190:39533 shutdown complete.
1fdcfa73b7c64888aecf3fe68513f1a4 4
2b85be8c8e8e4e3c97a5e19f886991f8 1
e12cd3e1edfd4acd81d026936404aa05 4
1fdcfa73b7c64888aecf3fe68513f1a4 3
2b85be8c8e8e4e3c97a5e19f886991f8 3
e12cd3e1edfd4acd81d026936404aa05 3
1fdcfa73b7c64888aecf3fe68513f1a4 8
2b85be8c8e8e4e3c97a5e19f886991f8 1
e12cd3e1edfd4acd81d026936404aa05 0
1fdcfa73b7c64888aecf3fe68513f1a4 3
2b85be8c8e8e4e3c97a5e19f886991f8 3
e12cd3e1edfd4acd81d026936404aa05 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (27507 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20240503 14:12:22.773934 12294 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.190:36563
I20240503 14:12:22.774616 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:22.777843 12776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.778663 12777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.779558 12779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:22.780486 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:22.780833 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:22.780910 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:22.780972 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745542780943 us; error 0 us; skew 500 ppm
I20240503 14:12:22.781136 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:22.787796 12294 webserver.cc:460] Webserver started at http://127.12.1.190:39421/ using document root <none> and password file <none>
I20240503 14:12:22.788053 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:22.788133 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:22.788245 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:22.788960 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/master-0-root/instance:
uuid: "5a1c073104df4d3791fc29cf98d41caa"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.791491 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:22.793151 12784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:22.793560 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:22.793676 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/master-0-root
uuid: "5a1c073104df4d3791fc29cf98d41caa"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.793838 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:22.803395 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:22.804023 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:22.817498 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.190:36563
I20240503 14:12:22.817520 12835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.190:36563 every 8 connection(s)
I20240503 14:12:22.818912 12836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:22.823066 12836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa: Bootstrap starting.
I20240503 14:12:22.824371 12836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:22.825923 12836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa: No bootstrap required, opened a new log
I20240503 14:12:22.826617 12836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER }
I20240503 14:12:22.826754 12836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:22.826817 12836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a1c073104df4d3791fc29cf98d41caa, State: Initialized, Role: FOLLOWER
I20240503 14:12:22.827009 12836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER }
I20240503 14:12:22.827149 12836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:12:22.827206 12836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:12:22.827284 12836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:22.828972 12836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER }
I20240503 14:12:22.829169 12836 leader_election.cc:302] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a1c073104df4d3791fc29cf98d41caa; no voters:
I20240503 14:12:22.829528 12836 leader_election.cc:288] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:12:22.829671 12839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:22.830170 12839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 1 LEADER]: Becoming Leader. State: Replica: 5a1c073104df4d3791fc29cf98d41caa, State: Running, Role: LEADER
I20240503 14:12:22.830410 12836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:12:22.830431 12839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER }
I20240503 14:12:22.831384 12840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a1c073104df4d3791fc29cf98d41caa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER } }
I20240503 14:12:22.831696 12840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [sys.catalog]: This master's current role is: LEADER
I20240503 14:12:22.831458 12841 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a1c073104df4d3791fc29cf98d41caa. Latest consensus state: current_term: 1 leader_uuid: "5a1c073104df4d3791fc29cf98d41caa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a1c073104df4d3791fc29cf98d41caa" member_type: VOTER } }
I20240503 14:12:22.832111 12841 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [sys.catalog]: This master's current role is: LEADER
I20240503 14:12:22.832979 12845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:12:22.834847 12845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:12:22.835495 12294 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 14:12:22.837886 12845 catalog_manager.cc:1347] Generated new cluster ID: 53728b308da34bf483373be24ca66382
I20240503 14:12:22.837970 12845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:12:22.857215 12845 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:12:22.858151 12845 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:12:22.869058 12845 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa: Generated new TSK 0
I20240503 14:12:22.869379 12845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:12:22.900540 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:22.904202 12857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.905025 12858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.906136 12860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:22.906689 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:22.906977 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:22.907066 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:22.907123 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745542907106 us; error 0 us; skew 500 ppm
I20240503 14:12:22.907297 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:22.908620 12294 webserver.cc:460] Webserver started at http://127.12.1.129:36929/ using document root <none> and password file <none>
I20240503 14:12:22.908881 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:22.908967 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:22.909106 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:22.909796 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-0-root/instance:
uuid: "fdab8f8e993343c485b56bae234e8ee7"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.912458 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:22.914279 12865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:22.914701 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240503 14:12:22.914861 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
uuid: "fdab8f8e993343c485b56bae234e8ee7"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.914986 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:22.922595 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:22.923243 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:22.923879 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:22.924811 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:22.924903 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:22.924998 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:22.925066 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:22.942046 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.129:39423
I20240503 14:12:22.942066 12927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.129:39423 every 8 connection(s)
I20240503 14:12:22.943900 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:22.948035 12932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.948814 12933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:22.950700 12935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:22.952080 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:22.952193 12928 heartbeater.cc:347] Connected to a master server at 127.12.1.190:36563
I20240503 14:12:22.952390 12928 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:22.952442 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:22.952531 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:22.952601 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745542952566 us; error 0 us; skew 500 ppm
I20240503 14:12:22.952775 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:22.952898 12928 heartbeater.cc:511] Master 127.12.1.190:36563 requested a full tablet report, sending...
I20240503 14:12:22.954030 12801 ts_manager.cc:194] Registered new tserver with Master: fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423)
I20240503 14:12:22.954314 12294 webserver.cc:460] Webserver started at http://127.12.1.130:37849/ using document root <none> and password file <none>
I20240503 14:12:22.954597 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:22.954715 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:22.954869 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:22.955607 12801 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45222
I20240503 14:12:22.955726 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-1-root/instance:
uuid: "7b8c86089c0445f8a239c7d252e4fb56"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.958482 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20240503 14:12:22.960590 12940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:22.960975 12294 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:22.961086 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
uuid: "7b8c86089c0445f8a239c7d252e4fb56"
format_stamp: "Formatted at 2024-05-03 14:12:22 on dist-test-slave-6fwv"
I20240503 14:12:22.961228 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:23.013250 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:23.013942 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:23.014580 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:23.015501 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:23.015587 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:23.015695 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:23.015745 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:23.031533 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.130:40615
I20240503 14:12:23.031551 13002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.130:40615 every 8 connection(s)
I20240503 14:12:23.033149 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:23.037519 13006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:23.038223 13007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:23.038579 13009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:23.039901 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:23.040208 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:23.040311 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:23.040383 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745543040354 us; error 0 us; skew 500 ppm
I20240503 14:12:23.040580 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:23.040556 13003 heartbeater.cc:347] Connected to a master server at 127.12.1.190:36563
I20240503 14:12:23.040726 13003 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:23.041143 13003 heartbeater.cc:511] Master 127.12.1.190:36563 requested a full tablet report, sending...
I20240503 14:12:23.042129 12294 webserver.cc:460] Webserver started at http://127.12.1.131:43101/ using document root <none> and password file <none>
I20240503 14:12:23.042130 12801 ts_manager.cc:194] Registered new tserver with Master: 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.042438 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:23.042536 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:23.042695 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:23.043231 12801 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45238
I20240503 14:12:23.043645 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-2-root/instance:
uuid: "c24788c795c748bd9b659828a72a0c10"
format_stamp: "Formatted at 2024-05-03 14:12:23 on dist-test-slave-6fwv"
I20240503 14:12:23.046188 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20240503 14:12:23.047888 13014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:23.048254 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:23.048381 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
uuid: "c24788c795c748bd9b659828a72a0c10"
format_stamp: "Formatted at 2024-05-03 14:12:23 on dist-test-slave-6fwv"
I20240503 14:12:23.048496 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1714745515193609-12294-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:23.063069 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:23.063706 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:23.064328 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:23.065274 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:23.065359 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:23.065466 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:23.065541 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:23.084828 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.131:35537
I20240503 14:12:23.084872 13076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.131:35537 every 8 connection(s)
I20240503 14:12:23.091804 13077 heartbeater.cc:347] Connected to a master server at 127.12.1.190:36563
I20240503 14:12:23.091959 13077 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:23.092347 13077 heartbeater.cc:511] Master 127.12.1.190:36563 requested a full tablet report, sending...
I20240503 14:12:23.093176 12801 ts_manager.cc:194] Registered new tserver with Master: c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.093709 12294 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007909014s
I20240503 14:12:23.093955 12801 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45242
I20240503 14:12:23.094911 12294 test_util.cc:268] Using random seed: 1325003362
I20240503 14:12:23.107847 12801 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45246:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 14:12:23.108719 12801 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 14:12:23.135808 13042 tablet_service.cc:1467] Processing CreateTablet for tablet 69725f3063c14ca58725ccb35262d938 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 14:12:23.136523 13042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69725f3063c14ca58725ccb35262d938. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.136626 13040 tablet_service.cc:1467] Processing CreateTablet for tablet 3dccfc0cec774ef09118992553a68b21 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 14:12:23.137183 13040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dccfc0cec774ef09118992553a68b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.137490 12893 tablet_service.cc:1467] Processing CreateTablet for tablet 69725f3063c14ca58725ccb35262d938 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 14:12:23.138000 12893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69725f3063c14ca58725ccb35262d938. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.138500 12892 tablet_service.cc:1467] Processing CreateTablet for tablet cfe76f29026545c0afd116ddae18079f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 14:12:23.139016 12892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe76f29026545c0afd116ddae18079f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.138890 13039 tablet_service.cc:1467] Processing CreateTablet for tablet 5868cf4f957b4f45804b74e282452d3f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 14:12:23.139190 12891 tablet_service.cc:1467] Processing CreateTablet for tablet 3dccfc0cec774ef09118992553a68b21 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 14:12:23.139405 13039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5868cf4f957b4f45804b74e282452d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.139644 12891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dccfc0cec774ef09118992553a68b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.142938 13041 tablet_service.cc:1467] Processing CreateTablet for tablet cfe76f29026545c0afd116ddae18079f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 14:12:23.144012 13041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe76f29026545c0afd116ddae18079f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.145275 12889 tablet_service.cc:1467] Processing CreateTablet for tablet 864a509fa7b243f4837c6d291174e726 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 14:12:23.146273 13037 tablet_service.cc:1467] Processing CreateTablet for tablet d49d6e0b3a4246eea494bb39695802d1 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 14:12:23.146693 13038 tablet_service.cc:1467] Processing CreateTablet for tablet 864a509fa7b243f4837c6d291174e726 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 14:12:23.148689 13037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49d6e0b3a4246eea494bb39695802d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.149019 12889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864a509fa7b243f4837c6d291174e726. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.150036 13035 tablet_service.cc:1467] Processing CreateTablet for tablet 46068d8586354b728524308d8e52fd93 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 14:12:23.150561 12888 tablet_service.cc:1467] Processing CreateTablet for tablet d49d6e0b3a4246eea494bb39695802d1 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 14:12:23.150671 12884 tablet_service.cc:1467] Processing CreateTablet for tablet 88a07c09b2ed4e8cbe95b951d77d5465 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 14:12:23.152024 13038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864a509fa7b243f4837c6d291174e726. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.152771 12888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49d6e0b3a4246eea494bb39695802d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.154089 12886 tablet_service.cc:1467] Processing CreateTablet for tablet 46068d8586354b728524308d8e52fd93 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 14:12:23.152829 13036 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8a5eb6f2b43b48e00be66a1851aca (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 14:12:23.154647 13034 tablet_service.cc:1467] Processing CreateTablet for tablet b26b4408f0b04e90a99712df4760357d (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 14:12:23.156931 13035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46068d8586354b728524308d8e52fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.157398 12884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a07c09b2ed4e8cbe95b951d77d5465. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.156854 13033 tablet_service.cc:1467] Processing CreateTablet for tablet 88a07c09b2ed4e8cbe95b951d77d5465 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 14:12:23.156891 12890 tablet_service.cc:1467] Processing CreateTablet for tablet 5868cf4f957b4f45804b74e282452d3f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 14:12:23.162734 13036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8a5eb6f2b43b48e00be66a1851aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.162770 12886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46068d8586354b728524308d8e52fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.170231 13034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26b4408f0b04e90a99712df4760357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.171815 12890 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5868cf4f957b4f45804b74e282452d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.173172 13033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a07c09b2ed4e8cbe95b951d77d5465. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.173226 12887 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8a5eb6f2b43b48e00be66a1851aca (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 14:12:23.176337 12965 tablet_service.cc:1467] Processing CreateTablet for tablet 5868cf4f957b4f45804b74e282452d3f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20240503 14:12:23.176528 12885 tablet_service.cc:1467] Processing CreateTablet for tablet b26b4408f0b04e90a99712df4760357d (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 14:12:23.177148 12968 tablet_service.cc:1467] Processing CreateTablet for tablet 69725f3063c14ca58725ccb35262d938 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20240503 14:12:23.181882 12966 tablet_service.cc:1467] Processing CreateTablet for tablet 3dccfc0cec774ef09118992553a68b21 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20240503 14:12:23.183490 12965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5868cf4f957b4f45804b74e282452d3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.183806 12887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8a5eb6f2b43b48e00be66a1851aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.183558 12967 tablet_service.cc:1467] Processing CreateTablet for tablet cfe76f29026545c0afd116ddae18079f (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20240503 14:12:23.181936 12962 tablet_service.cc:1467] Processing CreateTablet for tablet 55c8a5eb6f2b43b48e00be66a1851aca (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20240503 14:12:23.187811 12963 tablet_service.cc:1467] Processing CreateTablet for tablet d49d6e0b3a4246eea494bb39695802d1 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20240503 14:12:23.187840 12960 tablet_service.cc:1467] Processing CreateTablet for tablet b26b4408f0b04e90a99712df4760357d (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20240503 14:12:23.189833 12885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26b4408f0b04e90a99712df4760357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.190081 12968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69725f3063c14ca58725ccb35262d938. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.192888 13092 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.197712 12966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dccfc0cec774ef09118992553a68b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.195892 12964 tablet_service.cc:1467] Processing CreateTablet for tablet 864a509fa7b243f4837c6d291174e726 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20240503 14:12:23.192862 12959 tablet_service.cc:1467] Processing CreateTablet for tablet 88a07c09b2ed4e8cbe95b951d77d5465 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20240503 14:12:23.193866 12961 tablet_service.cc:1467] Processing CreateTablet for tablet 46068d8586354b728524308d8e52fd93 (DEFAULT_TABLE table=test-workload [id=26060aaed2cc4ee793e5d0e9e0f6f6a3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20240503 14:12:23.201494 12963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49d6e0b3a4246eea494bb39695802d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.213073 12962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55c8a5eb6f2b43b48e00be66a1851aca. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.215157 12961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46068d8586354b728524308d8e52fd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.215474 12964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 864a509fa7b243f4837c6d291174e726. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.216220 12959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a07c09b2ed4e8cbe95b951d77d5465. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.220368 12960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b26b4408f0b04e90a99712df4760357d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.228519 12967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfe76f29026545c0afd116ddae18079f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:23.229231 13092 tablet_bootstrap.cc:654] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.242753 13093 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.284770 13092 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.285109 13092 ts_tablet_manager.cc:1367] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.096s user 0.010s sys 0.009s
I20240503 14:12:23.288760 13092 raft_consensus.cc:348] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.290892 13092 raft_consensus.cc:374] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.292394 13095 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.292456 13092 raft_consensus.cc:729] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.297927 13093 tablet_bootstrap.cc:654] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.296566 13092 consensus_queue.cc:260] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.299903 13092 ts_tablet_manager.cc:1398] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20240503 14:12:23.299914 13077 heartbeater.cc:503] Master 127.12.1.190:36563 was elected leader, sending a full tablet report...
I20240503 14:12:23.300712 13092 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.302654 13095 tablet_bootstrap.cc:654] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.302678 13092 tablet_bootstrap.cc:654] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.302743 13093 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.303028 13093 ts_tablet_manager.cc:1367] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.005s
I20240503 14:12:23.303921 13093 raft_consensus.cc:348] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.304176 13093 raft_consensus.cc:374] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.304276 13093 raft_consensus.cc:729] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.304584 13093 consensus_queue.cc:260] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.311285 13092 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.311466 13095 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.311520 13092 ts_tablet_manager.cc:1367] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20240503 14:12:23.311630 13095 ts_tablet_manager.cc:1367] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.008s
I20240503 14:12:23.311986 13093 ts_tablet_manager.cc:1398] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.009s user 0.004s sys 0.004s
I20240503 14:12:23.312011 12928 heartbeater.cc:503] Master 127.12.1.190:36563 was elected leader, sending a full tablet report...
I20240503 14:12:23.312342 13093 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.312670 13092 raft_consensus.cc:348] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.312674 13095 raft_consensus.cc:348] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.313009 13092 raft_consensus.cc:374] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.313032 13095 raft_consensus.cc:374] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.313355 13092 raft_consensus.cc:729] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.313407 13095 raft_consensus.cc:729] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.313715 13092 consensus_queue.cc:260] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.313783 13095 consensus_queue.cc:260] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.314956 13093 tablet_bootstrap.cc:654] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.315621 13092 ts_tablet_manager.cc:1398] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20240503 14:12:23.315961 13092 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.317860 13092 tablet_bootstrap.cc:654] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.322688 13003 heartbeater.cc:503] Master 127.12.1.190:36563 was elected leader, sending a full tablet report...
I20240503 14:12:23.322650 13095 ts_tablet_manager.cc:1398] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.011s user 0.000s sys 0.011s
I20240503 14:12:23.323052 13095 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.323365 13093 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.323552 13093 ts_tablet_manager.cc:1367] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20240503 14:12:23.325016 13093 raft_consensus.cc:348] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.325301 13093 raft_consensus.cc:374] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.325388 13093 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.325625 13095 tablet_bootstrap.cc:654] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.325702 13093 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.327679 13093 ts_tablet_manager.cc:1398] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20240503 14:12:23.328063 13093 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.329885 13093 tablet_bootstrap.cc:654] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.332039 13092 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.332206 13092 ts_tablet_manager.cc:1367] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20240503 14:12:23.333050 13092 raft_consensus.cc:348] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.333237 13092 raft_consensus.cc:374] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.333335 13092 raft_consensus.cc:729] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.333546 13092 consensus_queue.cc:260] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.334043 13095 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.334098 13092 ts_tablet_manager.cc:1398] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240503 14:12:23.334232 13095 ts_tablet_manager.cc:1367] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.010s
I20240503 14:12:23.334406 13092 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.335125 13093 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.335052 13095 raft_consensus.cc:348] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.335285 13093 ts_tablet_manager.cc:1367] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240503 14:12:23.335294 13095 raft_consensus.cc:374] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.335433 13095 raft_consensus.cc:729] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.335824 13095 consensus_queue.cc:260] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.336359 13095 ts_tablet_manager.cc:1398] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.336443 13092 tablet_bootstrap.cc:654] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.336390 13093 raft_consensus.cc:348] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.336591 13093 raft_consensus.cc:374] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.337190 13093 raft_consensus.cc:729] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.337571 13095 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.337544 13093 consensus_queue.cc:260] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.338128 13093 ts_tablet_manager.cc:1398] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20240503 14:12:23.338424 13093 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.340227 13093 tablet_bootstrap.cc:654] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.340224 13095 tablet_bootstrap.cc:654] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.346602 13092 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.346845 13092 ts_tablet_manager.cc:1367] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.006s
I20240503 14:12:23.347743 13092 raft_consensus.cc:348] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.348037 13092 raft_consensus.cc:374] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.348122 13092 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.348368 13095 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.348537 13095 ts_tablet_manager.cc:1367] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20240503 14:12:23.348409 13092 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.349067 13092 ts_tablet_manager.cc:1398] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:23.349303 13095 raft_consensus.cc:348] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.349476 13092 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.349560 13095 raft_consensus.cc:374] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.349660 13095 raft_consensus.cc:729] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.349908 13095 consensus_queue.cc:260] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.350498 13095 ts_tablet_manager.cc:1398] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.351482 13092 tablet_bootstrap.cc:654] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.352118 13095 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.353372 13093 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.353557 13093 ts_tablet_manager.cc:1367] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.011s
I20240503 14:12:23.353881 13095 tablet_bootstrap.cc:654] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.354391 13093 raft_consensus.cc:348] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.354636 13093 raft_consensus.cc:374] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.354749 13093 raft_consensus.cc:729] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.355052 13093 consensus_queue.cc:260] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.356220 13093 ts_tablet_manager.cc:1398] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:12:23.356547 13093 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.358969 13093 tablet_bootstrap.cc:654] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.359652 13092 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.359854 13092 ts_tablet_manager.cc:1367] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240503 14:12:23.359952 13095 tablet_bootstrap.cc:492] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.360128 13095 ts_tablet_manager.cc:1367] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20240503 14:12:23.360744 13095 raft_consensus.cc:348] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.360780 13092 raft_consensus.cc:348] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.360934 13095 raft_consensus.cc:374] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.361006 13092 raft_consensus.cc:374] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.361013 13095 raft_consensus.cc:729] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.361124 13092 raft_consensus.cc:729] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.361323 13095 consensus_queue.cc:260] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.361377 13092 consensus_queue.cc:260] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.361826 13095 ts_tablet_manager.cc:1398] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:23.362071 13092 ts_tablet_manager.cc:1398] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:23.362185 13095 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.362360 13092 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.364605 13095 tablet_bootstrap.cc:654] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.364632 13092 tablet_bootstrap.cc:654] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.372807 13092 tablet_bootstrap.cc:492] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.372928 13095 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.373018 13092 ts_tablet_manager.cc:1367] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240503 14:12:23.373113 13095 ts_tablet_manager.cc:1367] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20240503 14:12:23.374030 13092 raft_consensus.cc:348] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.374202 13095 raft_consensus.cc:348] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.374289 13092 raft_consensus.cc:374] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.374424 13095 raft_consensus.cc:374] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.374428 13092 raft_consensus.cc:729] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.374528 13095 raft_consensus.cc:729] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.374605 13093 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.374745 13093 ts_tablet_manager.cc:1367] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.014s
I20240503 14:12:23.374780 13092 consensus_queue.cc:260] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.374784 13095 consensus_queue.cc:260] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.375455 13092 ts_tablet_manager.cc:1398] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:23.375514 13095 ts_tablet_manager.cc:1398] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:23.375540 13093 raft_consensus.cc:348] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.375710 13093 raft_consensus.cc:374] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.375808 13092 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.375833 13093 raft_consensus.cc:729] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.375804 13095 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.376149 13093 consensus_queue.cc:260] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.379575 13092 tablet_bootstrap.cc:654] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.380456 13093 ts_tablet_manager.cc:1398] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:23.380496 13095 tablet_bootstrap.cc:654] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.381150 13093 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.383035 13093 tablet_bootstrap.cc:654] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.384245 13095 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.384246 13092 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.384450 13092 ts_tablet_manager.cc:1367] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20240503 14:12:23.384568 13095 ts_tablet_manager.cc:1367] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20240503 14:12:23.385303 13093 tablet_bootstrap.cc:492] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.385460 13093 ts_tablet_manager.cc:1367] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240503 14:12:23.385370 13092 raft_consensus.cc:348] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.385370 13095 raft_consensus.cc:348] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.385617 13092 raft_consensus.cc:374] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.385725 13095 raft_consensus.cc:374] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.385732 13092 raft_consensus.cc:729] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.385850 13095 raft_consensus.cc:729] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.386090 13095 consensus_queue.cc:260] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.386016 13092 consensus_queue.cc:260] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.386663 13093 raft_consensus.cc:348] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.386911 13093 raft_consensus.cc:374] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.386963 13095 ts_tablet_manager.cc:1398] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240503 14:12:23.387010 13093 raft_consensus.cc:729] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.387300 13095 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.387323 13093 consensus_queue.cc:260] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.387727 13092 ts_tablet_manager.cc:1398] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:23.387873 13093 ts_tablet_manager.cc:1398] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.387995 13092 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.388190 13093 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.389962 13092 tablet_bootstrap.cc:654] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.390002 13093 tablet_bootstrap.cc:654] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.392458 13095 tablet_bootstrap.cc:654] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.396664 13093 tablet_bootstrap.cc:492] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.397333 13093 ts_tablet_manager.cc:1367] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20240503 14:12:23.397636 13092 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.397819 13092 ts_tablet_manager.cc:1367] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20240503 14:12:23.398244 13095 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.398160 13093 raft_consensus.cc:348] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.398433 13093 raft_consensus.cc:374] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.398514 13093 raft_consensus.cc:729] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.398608 13095 ts_tablet_manager.cc:1367] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20240503 14:12:23.398689 13092 raft_consensus.cc:348] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.398736 13093 consensus_queue.cc:260] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.398911 13092 raft_consensus.cc:374] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.398993 13092 raft_consensus.cc:729] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.399241 13093 ts_tablet_manager.cc:1398] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.399271 13092 consensus_queue.cc:260] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.399529 13093 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.399803 13092 ts_tablet_manager.cc:1398] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20240503 14:12:23.400137 13092 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.401350 13093 tablet_bootstrap.cc:654] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.401762 13092 tablet_bootstrap.cc:654] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.403441 13095 raft_consensus.cc:348] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.403715 13095 raft_consensus.cc:374] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.404103 13095 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.404496 13095 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.405843 13095 ts_tablet_manager.cc:1398] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240503 14:12:23.406251 13095 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.408205 13095 tablet_bootstrap.cc:654] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.410321 13093 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.410516 13093 ts_tablet_manager.cc:1367] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.007s
I20240503 14:12:23.411041 13092 tablet_bootstrap.cc:492] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.411197 13092 ts_tablet_manager.cc:1367] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20240503 14:12:23.411352 13093 raft_consensus.cc:348] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.411511 13095 tablet_bootstrap.cc:492] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.411579 13093 raft_consensus.cc:374] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.411669 13095 ts_tablet_manager.cc:1367] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240503 14:12:23.411674 13093 raft_consensus.cc:729] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.412003 13093 consensus_queue.cc:260] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.411978 13092 raft_consensus.cc:348] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.412247 13092 raft_consensus.cc:374] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.412366 13092 raft_consensus.cc:729] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.412504 13093 ts_tablet_manager.cc:1398] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.412670 13092 consensus_queue.cc:260] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.412806 13093 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.413256 13092 ts_tablet_manager.cc:1398] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:23.413590 13092 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: Bootstrap starting.
I20240503 14:12:23.414707 13093 tablet_bootstrap.cc:654] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.415359 13092 tablet_bootstrap.cc:654] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.416244 13095 raft_consensus.cc:348] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.416527 13095 raft_consensus.cc:374] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.416613 13095 raft_consensus.cc:729] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.416857 13095 consensus_queue.cc:260] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.419661 13095 ts_tablet_manager.cc:1398] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20240503 14:12:23.420687 13095 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.422580 13095 tablet_bootstrap.cc:654] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.422982 13092 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: No bootstrap required, opened a new log
I20240503 14:12:23.422988 13093 tablet_bootstrap.cc:492] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.423162 13092 ts_tablet_manager.cc:1367] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240503 14:12:23.423169 13093 ts_tablet_manager.cc:1367] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20240503 14:12:23.423955 13093 raft_consensus.cc:348] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.423934 13092 raft_consensus.cc:348] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.424144 13093 raft_consensus.cc:374] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.424212 13092 raft_consensus.cc:374] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.424257 13093 raft_consensus.cc:729] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.424295 13092 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.424544 13092 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.424543 13093 consensus_queue.cc:260] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.424847 13095 tablet_bootstrap.cc:492] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.425029 13095 ts_tablet_manager.cc:1367] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240503 14:12:23.425222 13092 ts_tablet_manager.cc:1398] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:23.425748 13093 ts_tablet_manager.cc:1398] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:23.425877 13095 raft_consensus.cc:348] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.426077 13093 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: Bootstrap starting.
I20240503 14:12:23.426183 13095 raft_consensus.cc:374] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.426337 13095 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.426679 13095 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.427381 13095 ts_tablet_manager.cc:1398] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:23.427726 13095 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: Bootstrap starting.
I20240503 14:12:23.427868 13093 tablet_bootstrap.cc:654] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.430131 13095 tablet_bootstrap.cc:654] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:23.432416 13095 tablet_bootstrap.cc:492] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: No bootstrap required, opened a new log
I20240503 14:12:23.432588 13095 ts_tablet_manager.cc:1367] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20240503 14:12:23.433219 13095 raft_consensus.cc:348] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.433406 13095 raft_consensus.cc:374] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.433475 13095 raft_consensus.cc:729] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.433689 13095 consensus_queue.cc:260] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.434168 13095 ts_tablet_manager.cc:1398] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 14:12:23.434587 13093 tablet_bootstrap.cc:492] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: No bootstrap required, opened a new log
I20240503 14:12:23.434737 13093 ts_tablet_manager.cc:1367] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20240503 14:12:23.435343 13093 raft_consensus.cc:348] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.435519 13093 raft_consensus.cc:374] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:23.435602 13093 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Initialized, Role: FOLLOWER
I20240503 14:12:23.435813 13093 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.436303 13093 ts_tablet_manager.cc:1398] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 14:12:23.483412 13096 raft_consensus.cc:482] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.483621 13096 raft_consensus.cc:504] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.484475 13096 leader_election.cc:288] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.490900 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.490937 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.491290 12978 raft_consensus.cc:2454] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.491292 12903 raft_consensus.cc:2454] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.491798 13017 leader_election.cc:302] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.492071 13096 raft_consensus.cc:2781] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.492180 13096 raft_consensus.cc:482] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.492264 13096 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.494257 13096 raft_consensus.cc:504] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.494887 13096 leader_election.cc:288] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.495257 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.495307 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.495450 12903 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.495476 12978 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.497622 12903 raft_consensus.cc:2454] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.497632 12978 raft_consensus.cc:2454] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.498015 13015 leader_election.cc:302] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.498275 13096 raft_consensus.cc:2781] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.498651 13096 raft_consensus.cc:686] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:23.498963 13096 consensus_queue.cc:237] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.502045 12799 catalog_manager.cc:5484] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:23.505072 13101 raft_consensus.cc:482] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.505228 13101 raft_consensus.cc:504] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.506124 13101 leader_election.cc:288] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.512245 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.512245 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.512588 12903 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.512653 13052 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.513556 12941 leader_election.cc:302] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.513861 13101 raft_consensus.cc:2781] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.513967 13101 raft_consensus.cc:482] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.514091 13101 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.516129 13101 raft_consensus.cc:504] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.516759 13101 leader_election.cc:288] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.517266 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.517272 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.517501 13052 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.517509 12903 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.518453 13096 raft_consensus.cc:482] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.518631 13096 raft_consensus.cc:504] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.519763 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.519811 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.520009 12978 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.520044 12902 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.520437 13017 leader_election.cc:302] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.520599 12903 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.520468 13100 raft_consensus.cc:482] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.520749 13052 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.520812 13129 raft_consensus.cc:2781] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.520916 13129 raft_consensus.cc:482] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.520789 13100 raft_consensus.cc:504] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.521041 13129 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.522013 13100 leader_election.cc:288] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.522161 13132 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.522857 12941 leader_election.cc:302] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.522347 13132 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.523443 13101 raft_consensus.cc:2781] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.523818 13096 leader_election.cc:288] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.529918 13132 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.532683 13101 raft_consensus.cc:686] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:23.533094 13135 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.533174 13101 consensus_queue.cc:237] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.533341 13135 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.536196 13135 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.536046 13096 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.536896 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.536881 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.538014 12903 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.537704 13096 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.540940 12941 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.541220 13052 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.544258 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.544606 13135 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.544934 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.545181 12903 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.545843 13096 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.546000 12978 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.546162 13015 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.547446 13135 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.548058 13096 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.548578 13096 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.548899 13135 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.549589 13096 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.547145 13129 raft_consensus.cc:504] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.550765 13136 raft_consensus.cc:482] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.551635 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.552210 13129 leader_election.cc:288] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.551904 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.554128 13129 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.554834 12978 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 0.
I20240503 14:12:23.554513 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.556260 13052 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 0.
I20240503 14:12:23.555276 12799 catalog_manager.cc:5484] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:23.555945 13129 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.554991 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.556576 12976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.557761 13051 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 0.
I20240503 14:12:23.557885 12976 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.553335 13136 raft_consensus.cc:504] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.558724 12868 leader_election.cc:302] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.560441 12977 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 0.
I20240503 14:12:23.560950 13132 raft_consensus.cc:2781] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.561436 13129 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.561167 12868 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.562259 13100 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.562280 13132 raft_consensus.cc:482] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.563133 12903 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.563439 12903 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.564163 13132 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.564671 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.564188 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.565542 13100 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.565711 13129 raft_consensus.cc:482] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.565904 13100 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.567117 13129 raft_consensus.cc:504] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.567684 12978 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.567960 13135 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.570227 13135 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.569855 13096 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.571964 13136 leader_election.cc:288] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537), fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423)
I20240503 14:12:23.572081 13129 leader_election.cc:288] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.572103 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.572230 13017 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.572361 13051 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.572527 13129 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.571214 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.573890 12903 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.574517 13096 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.570097 12901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.574749 13052 raft_consensus.cc:2379] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b8c86089c0445f8a239c7d252e4fb56 in current term 1: Already voted for candidate c24788c795c748bd9b659828a72a0c10 in this term.
I20240503 14:12:23.574841 13129 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.575049 12901 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.572125 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.575059 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.575294 12900 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.575016 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.571218 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.575829 12977 raft_consensus.cc:2379] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c24788c795c748bd9b659828a72a0c10 in current term 1: Already voted for candidate 7b8c86089c0445f8a239c7d252e4fb56 in this term.
I20240503 14:12:23.575805 12976 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.575912 12899 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.576054 12900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.576099 12943 leader_election.cc:302] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.576146 12978 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.576274 13100 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.576366 13136 raft_consensus.cc:2781] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.576366 13015 leader_election.cc:302] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.576793 13136 raft_consensus.cc:482] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.576923 13136 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.577122 13129 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.577579 13096 raft_consensus.cc:2781] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.577823 12902 raft_consensus.cc:2379] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c24788c795c748bd9b659828a72a0c10 in current term 1: Already voted for candidate fdab8f8e993343c485b56bae234e8ee7 in this term.
I20240503 14:12:23.577473 13015 leader_election.cc:302] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.578603 13100 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.579114 13096 raft_consensus.cc:686] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:23.577265 13132 raft_consensus.cc:504] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.581642 13132 leader_election.cc:288] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.581737 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.581825 13138 raft_consensus.cc:2781] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.581944 13138 raft_consensus.cc:482] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.582242 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.582242 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.582644 12977 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.582849 12978 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.584928 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.585158 13051 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.584931 13096 consensus_queue.cc:237] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.585198 13138 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.585822 13015 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c24788c795c748bd9b659828a72a0c10; no voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.587121 12899 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.586349 13129 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.588493 13052 raft_consensus.cc:2379] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fdab8f8e993343c485b56bae234e8ee7 in current term 1: Already voted for candidate c24788c795c748bd9b659828a72a0c10 in this term.
I20240503 14:12:23.588438 12941 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters: c24788c795c748bd9b659828a72a0c10
I20240503 14:12:23.589311 13139 raft_consensus.cc:2726] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 14:12:23.589735 13129 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.589908 13135 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.591943 13135 raft_consensus.cc:686] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:23.592824 12976 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.592491 13135 consensus_queue.cc:237] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.593366 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.594027 12899 raft_consensus.cc:2379] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c24788c795c748bd9b659828a72a0c10 in current term 1: Already voted for candidate fdab8f8e993343c485b56bae234e8ee7 in this term.
I20240503 14:12:23.594573 13015 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c24788c795c748bd9b659828a72a0c10; no voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.595242 12977 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 1.
I20240503 14:12:23.595729 13051 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 1.
I20240503 14:12:23.595757 13139 raft_consensus.cc:2726] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 14:12:23.596096 12868 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters: c24788c795c748bd9b659828a72a0c10
I20240503 14:12:23.596406 13132 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.596554 13132 raft_consensus.cc:686] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:23.596848 13132 consensus_queue.cc:237] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.596557 12868 leader_election.cc:302] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.598606 13100 raft_consensus.cc:2781] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.598603 12799 catalog_manager.cc:5484] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:23.600474 12801 catalog_manager.cc:5484] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:23.606360 12978 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 1.
I20240503 14:12:23.606483 13136 raft_consensus.cc:504] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.607457 13136 leader_election.cc:288] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Requested vote from peers c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537), fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423)
I20240503 14:12:23.607944 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.608201 12899 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.610265 13138 raft_consensus.cc:504] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.610576 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.610805 13051 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.611296 13138 leader_election.cc:288] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.611176 12801 catalog_manager.cc:5484] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 1 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:23.611564 12899 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.611817 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.611991 12941 leader_election.cc:302] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:23.612072 12978 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.612347 13136 raft_consensus.cc:2781] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.612625 13136 raft_consensus.cc:686] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:23.612965 13136 consensus_queue.cc:237] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:23.614601 13051 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.615393 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.615607 12899 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.616111 13100 raft_consensus.cc:686] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:23.616268 12978 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.616703 13017 leader_election.cc:302] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.616643 13100 consensus_queue.cc:237] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.617082 13138 raft_consensus.cc:2781] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.617408 13138 raft_consensus.cc:686] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:23.617727 13138 consensus_queue.cc:237] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.619728 12899 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.619876 12801 catalog_manager.cc:5484] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:23.622587 12799 catalog_manager.cc:5484] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 1 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:23.623685 12800 catalog_manager.cc:5484] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:23.640455 13138 raft_consensus.cc:482] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.640653 13138 raft_consensus.cc:504] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.641327 13138 leader_election.cc:288] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.641820 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56" is_pre_election: true
I20240503 14:12:23.641824 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.642110 12978 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.642150 12899 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 0.
I20240503 14:12:23.642494 13017 leader_election.cc:302] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.642778 13138 raft_consensus.cc:2781] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.642896 13138 raft_consensus.cc:482] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.642973 13138 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.644819 13138 raft_consensus.cc:504] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.645386 13138 leader_election.cc:288] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:23.645789 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.645793 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.646034 12899 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.646072 12978 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.648093 12978 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.648089 12899 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 1.
I20240503 14:12:23.648499 13017 leader_election.cc:302] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.648772 13138 raft_consensus.cc:2781] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.648902 13138 raft_consensus.cc:686] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:23.649190 13138 consensus_queue.cc:237] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.652271 12800 catalog_manager.cc:5484] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 0 to 1, leader changed from <none> to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:23.748944 13136 raft_consensus.cc:482] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:23.749226 13136 raft_consensus.cc:504] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.749951 13136 leader_election.cc:288] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.750543 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7" is_pre_election: true
I20240503 14:12:23.750582 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10" is_pre_election: true
I20240503 14:12:23.750813 12899 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.750819 13051 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 0.
I20240503 14:12:23.751237 12943 leader_election.cc:302] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.751514 13136 raft_consensus.cc:2781] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:23.751617 13136 raft_consensus.cc:482] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:23.751734 13136 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.753719 13136 raft_consensus.cc:504] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.754447 13136 leader_election.cc:288] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.755013 12899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:23.755057 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.755210 12899 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.755278 13051 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:23.757407 13051 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.757385 12899 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 1.
I20240503 14:12:23.757908 12943 leader_election.cc:302] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:23.758324 13136 raft_consensus.cc:2781] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:23.758491 13136 raft_consensus.cc:686] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:23.758821 13136 consensus_queue.cc:237] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.761574 12800 catalog_manager.cc:5484] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:23.878077 12978 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "69725f3063c14ca58725ccb35262d938"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:40226
I20240503 14:12:23.878319 12978 raft_consensus.cc:595] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.881843 12978 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:40226
I20240503 14:12:23.882086 12978 raft_consensus.cc:595] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.888684 13051 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:23.888908 13051 raft_consensus.cc:595] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.891037 13051 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "864a509fa7b243f4837c6d291174e726"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:23.891234 13051 raft_consensus.cc:595] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:23.893078 13051 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:23.893251 13051 raft_consensus.cc:595] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Received request to transfer leadership to TS 7b8c86089c0445f8a239c7d252e4fb56
I20240503 14:12:23.897171 13051 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:23.897377 13051 raft_consensus.cc:595] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Received request to transfer leadership to TS 7b8c86089c0445f8a239c7d252e4fb56
I20240503 14:12:23.903578 12899 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:50672
I20240503 14:12:23.903810 12899 raft_consensus.cc:595] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Received request to transfer leadership to TS c24788c795c748bd9b659828a72a0c10
I20240503 14:12:23.975778 13138 consensus_queue.cc:1035] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:23.977171 13100 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:23.978711 13096 raft_consensus.cc:979] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:23.978920 13138 raft_consensus.cc:1067] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:23.979768 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50640
I20240503 14:12:23.979990 12902 raft_consensus.cc:482] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:23.980129 12902 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:23.983165 12902 raft_consensus.cc:504] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.983263 13129 consensus_queue.cc:1035] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:23.984288 12899 raft_consensus.cc:1226] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Rejecting Update request from peer c24788c795c748bd9b659828a72a0c10 for earlier term 1. Current term is 2. Ops: []
I20240503 14:12:23.984753 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:23.985136 13138 consensus_queue.cc:1046] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:23.985443 13138 raft_consensus.cc:3032] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:23.985543 13138 raft_consensus.cc:729] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:23.985836 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5868cf4f957b4f45804b74e282452d3f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:23.985844 13138 consensus_queue.cc:260] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.986204 13138 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:23.986197 12902 leader_election.cc:288] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:23.988473 13100 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:23.993253 13051 raft_consensus.cc:2454] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:23.994015 12868 leader_election.cc:302] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters: 7b8c86089c0445f8a239c7d252e4fb56
I20240503 14:12:23.994350 13100 raft_consensus.cc:2781] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:23.994521 13100 raft_consensus.cc:686] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:23.995028 13100 consensus_queue.cc:237] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:23.998030 12800 catalog_manager.cc:5484] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 1 to 2, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.025018 13136 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.027293 13138 consensus_queue.cc:1035] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.031594 13136 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:24.033150 13129 raft_consensus.cc:979] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.033382 13129 raft_consensus.cc:1067] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.034612 12900 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "864a509fa7b243f4837c6d291174e726"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50640
I20240503 14:12:24.034868 12900 raft_consensus.cc:482] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.034994 12900 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.035828 13139 consensus_queue.cc:1035] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.038053 12900 raft_consensus.cc:504] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.038861 12900 leader_election.cc:288] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:24.039450 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:24.039556 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "864a509fa7b243f4837c6d291174e726" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:24.039656 12978 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.039846 13051 raft_consensus.cc:3032] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.039935 13051 raft_consensus.cc:729] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:24.040218 13051 consensus_queue.cc:260] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.040594 13051 raft_consensus.cc:3037] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.040930 12902 raft_consensus.cc:1226] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Rejecting Update request from peer c24788c795c748bd9b659828a72a0c10 for earlier term 1. Current term is 2. Ops: []
I20240503 14:12:24.042865 12978 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.043329 13051 raft_consensus.cc:2454] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.043292 12868 leader_election.cc:302] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:24.043658 13100 raft_consensus.cc:2781] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.043794 13100 raft_consensus.cc:686] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:24.044099 13100 consensus_queue.cc:237] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.046319 12799 catalog_manager.cc:5484] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 1 to 2, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.047462 13136 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.051765 13136 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.055214 13135 raft_consensus.cc:979] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.055402 13135 raft_consensus.cc:1067] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.056051 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "69725f3063c14ca58725ccb35262d938"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50656
I20240503 14:12:24.056221 12902 raft_consensus.cc:482] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.056349 12902 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.058490 12902 raft_consensus.cc:504] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:24.059098 12902 leader_election.cc:288] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Requested vote from peers c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:24.059360 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:24.059478 12978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:24.059634 13051 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.059657 12978 raft_consensus.cc:3032] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.059756 12978 raft_consensus.cc:729] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:24.060065 12978 consensus_queue.cc:260] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:24.060441 12978 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.062597 13051 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.063056 12868 leader_election.cc:302] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:24.063338 13100 raft_consensus.cc:2781] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.063095 12978 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.063514 13100 raft_consensus.cc:686] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:24.063819 13100 consensus_queue.cc:237] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:24.065234 13139 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.066193 12800 catalog_manager.cc:5484] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 1 to 2, leader changed from 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.069738 13138 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.073923 13096 raft_consensus.cc:979] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: : Instructing follower 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:24.074110 13096 raft_consensus.cc:1067] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Signalling peer 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:24.074991 13138 consensus_queue.cc:1035] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.075043 12978 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:40198
I20240503 14:12:24.075261 12978 raft_consensus.cc:482] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.075356 12978 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.078712 12978 raft_consensus.cc:504] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.079480 13129 raft_consensus.cc:979] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: : Instructing follower 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:24.079562 12978 leader_election.cc:288] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 2 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:24.079668 13129 raft_consensus.cc:1067] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Signalling peer 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:24.080189 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:24.080412 12902 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.080286 13051 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:24.081498 13051 raft_consensus.cc:3032] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.081655 13051 raft_consensus.cc:729] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:24.082022 13051 consensus_queue.cc:260] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.082250 13129 consensus_queue.cc:1035] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.082551 13051 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.083070 12977 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:40198
I20240503 14:12:24.083258 12977 raft_consensus.cc:482] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.083398 12977 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.084388 12902 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 2.
I20240503 14:12:24.086217 12977 raft_consensus.cc:504] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.086468 12941 leader_election.cc:302] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:24.086760 13135 raft_consensus.cc:2781] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.086933 13135 raft_consensus.cc:686] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:24.087205 13135 consensus_queue.cc:237] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.087363 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:24.087569 13052 raft_consensus.cc:3032] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.087666 13052 raft_consensus.cc:729] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:24.087936 13052 consensus_queue.cc:260] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.088197 13052 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.089730 12800 catalog_manager.cc:5484] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 1 to 2, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.090562 13135 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.090768 13136 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.091657 13052 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 2.
I20240503 14:12:24.091995 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b26b4408f0b04e90a99712df4760357d" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:24.092172 12902 raft_consensus.cc:3037] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.092751 12943 leader_election.cc:302] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:24.093466 13136 raft_consensus.cc:2781] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.093628 13136 raft_consensus.cc:686] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:24.086215 13051 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 2.
I20240503 14:12:24.093997 12977 leader_election.cc:288] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 2 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:24.093901 13136 consensus_queue.cc:237] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.097149 12902 raft_consensus.cc:2454] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 2.
I20240503 14:12:24.097597 12799 catalog_manager.cc:5484] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 1 to 2, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.106024 13136 raft_consensus.cc:979] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.106199 13136 raft_consensus.cc:1067] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:24.106935 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50656
I20240503 14:12:24.107193 12902 raft_consensus.cc:482] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.107323 12902 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.109418 12902 raft_consensus.cc:504] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.110023 12902 leader_election.cc:288] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:24.110445 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:24.110572 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:24.110685 12977 raft_consensus.cc:3032] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.110812 12977 raft_consensus.cc:729] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:24.110817 13052 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.111116 12977 consensus_queue.cc:260] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.111547 12977 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.113207 13052 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.113562 12868 leader_election.cc:302] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:24.113857 13100 raft_consensus.cc:2781] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.114039 13100 raft_consensus.cc:686] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:24.114132 12977 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:24.114322 13100 consensus_queue.cc:237] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.116392 12800 catalog_manager.cc:5484] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 1 to 2, leader changed from 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:24.150471 13100 consensus_queue.cc:1035] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.155103 13100 consensus_queue.cc:1035] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.158285 13132 raft_consensus.cc:979] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:24.158447 13132 raft_consensus.cc:1067] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Signalling peer c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:24.159104 13052 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:32960
I20240503 14:12:24.159328 13052 raft_consensus.cc:482] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:24.159475 13052 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.161609 13052 raft_consensus.cc:504] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.162192 13052 leader_election.cc:288] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:24.162591 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:24.162639 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a07c09b2ed4e8cbe95b951d77d5465" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:24.162750 12902 raft_consensus.cc:3032] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:24.162850 12902 raft_consensus.cc:729] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:24.162873 12977 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.163105 12902 consensus_queue.cc:260] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.163452 12902 raft_consensus.cc:3037] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.165144 12977 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:24.165345 12902 raft_consensus.cc:2454] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:24.165509 13017 leader_election.cc:302] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:24.165836 13139 raft_consensus.cc:2781] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:24.165967 13139 raft_consensus.cc:686] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:24.166327 13139 consensus_queue.cc:237] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:24.168319 12799 catalog_manager.cc:5484] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 1 to 2, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:24.234474 13101 consensus_queue.cc:1035] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.239425 13101 consensus_queue.cc:1035] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:24.465382 12977 raft_consensus.cc:1261] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.465994 13132 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.468813 12902 raft_consensus.cc:1261] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.469336 13135 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.469851 13052 raft_consensus.cc:1261] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.470429 13143 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.472688 13051 raft_consensus.cc:1261] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.473222 13101 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.514946 13052 raft_consensus.cc:1261] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.515532 13132 consensus_queue.cc:1035] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.518985 12977 raft_consensus.cc:1261] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.519479 13132 consensus_queue.cc:1035] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.537401 13052 raft_consensus.cc:1261] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.538033 13132 consensus_queue.cc:1035] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.541237 12977 raft_consensus.cc:3037] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:24.544559 12977 raft_consensus.cc:1261] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.545023 13100 consensus_queue.cc:1035] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.560513 12902 raft_consensus.cc:1261] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.561128 13101 consensus_queue.cc:1035] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.563174 12900 raft_consensus.cc:1261] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.563648 13139 consensus_queue.cc:1035] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.565358 13052 raft_consensus.cc:1261] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.565927 13136 consensus_queue.cc:1035] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.568167 12977 raft_consensus.cc:1261] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.568730 13129 consensus_queue.cc:1035] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.650671 13052 raft_consensus.cc:1261] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.651248 13132 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:24.654269 12977 raft_consensus.cc:1261] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:24.654824 13132 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:26.916008 12294 auto_leader_rebalancer-test.cc:331] The leader distribution is
I20240503 14:12:26.916291 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:26.924281 12977 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
mode: GRACEFUL
new_leader_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:40234
I20240503 14:12:26.924516 12977 raft_consensus.cc:595] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Received request to transfer leadership to TS c24788c795c748bd9b659828a72a0c10
I20240503 14:12:26.930680 12902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:50686
I20240503 14:12:26.930935 12902 raft_consensus.cc:595] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Received request to transfer leadership to TS c24788c795c748bd9b659828a72a0c10
I20240503 14:12:26.931438 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 2
I20240503 14:12:26.931648 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:27.084466 13101 raft_consensus.cc:979] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: : Instructing follower c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:27.084669 13101 raft_consensus.cc:1067] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Signalling peer c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:27.085321 13052 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:32958
I20240503 14:12:27.085516 13052 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:27.085615 13052 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.087576 13052 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.088210 13052 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:27.088645 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:27.088702 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:27.088866 12977 raft_consensus.cc:3032] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:27.088917 12902 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.088964 12977 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:27.089193 12977 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.089493 12977 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.091080 12902 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:27.091370 12977 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:27.091550 13015 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:27.091890 13174 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:27.092334 13174 raft_consensus.cc:686] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:27.092648 13174 consensus_queue.cc:237] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.095355 12799 catalog_manager.cc:5484] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 1 to 2, leader changed from 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130) to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:27.298622 13132 raft_consensus.cc:979] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:27.298807 13132 raft_consensus.cc:1067] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Signalling peer c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:27.299435 13051 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:32960
I20240503 14:12:27.299660 13051 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:27.299764 13051 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.302330 13051 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.303010 13051 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:27.303545 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:27.303552 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:27.303826 12902 raft_consensus.cc:3032] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:27.303823 12977 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.303956 12902 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:27.304245 12902 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.304627 12902 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:27.307096 12977 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:27.307453 12902 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 2.
I20240503 14:12:27.307618 13017 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:27.307931 13174 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:27.308102 13174 raft_consensus.cc:686] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:27.308382 13174 consensus_queue.cc:237] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:27.311106 12799 catalog_manager.cc:5484] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 1 to 2, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 2 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:27.590431 12902 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:27.591058 13174 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:27.595095 12977 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:27.596239 13174 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:27.862253 12977 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:27.862891 13180 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:27.866544 12902 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:27.867386 13191 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:27.932104 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:27.933954 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:27.934190 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:28.934608 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:28.936317 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:28.936520 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:29.937016 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:29.939144 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:29.939474 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:30.939954 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:30.941695 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:30.941903 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:31.942428 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:31.944267 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:31.944506 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:32.944856 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:32.946666 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:32.946851 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:33.951113 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:33.952997 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:33.953217 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:34.953936 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:34.955703 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:34.955921 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:35.956386 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:35.958102 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:35.958308 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:36.969031 12294 auto_leader_rebalancer-test.cc:350] The leader distribution is
I20240503 14:12:36.971513 13052 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:36.971735 13052 raft_consensus.cc:595] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:36.976310 12977 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:40226
I20240503 14:12:36.976541 12977 raft_consensus.cc:595] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:36.978338 13052 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:32962
I20240503 14:12:36.978528 13052 raft_consensus.cc:595] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:36.980582 12977 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "46068d8586354b728524308d8e52fd93"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
mode: GRACEFUL
new_leader_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:40226
I20240503 14:12:36.980818 12977 raft_consensus.cc:595] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Received request to transfer leadership to TS fdab8f8e993343c485b56bae234e8ee7
I20240503 14:12:36.990669 13191 raft_consensus.cc:979] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:36.990821 13191 raft_consensus.cc:1067] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:36.991370 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50640
I20240503 14:12:36.991576 12902 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:36.991663 12902 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:36.993561 12902 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:36.994226 12902 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:36.995087 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:36.995129 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:36.995357 12977 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:36.995388 13052 raft_consensus.cc:3032] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:36.995472 13052 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:36.995787 13052 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:36.996142 13052 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:36.997571 12977 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:36.998005 12868 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:36.998209 13052 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:36.998281 13132 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:36.998432 13132 raft_consensus.cc:686] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:36.998703 13132 consensus_queue.cc:237] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.001628 12799 catalog_manager.cc:5484] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 2 to 3, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 3 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:37.167552 13198 raft_consensus.cc:979] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.167727 13198 raft_consensus.cc:1067] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.168396 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50640
I20240503 14:12:37.168563 12902 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:37.168656 12902 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.171078 12902 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.171622 12902 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:37.172164 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:37.172164 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:37.172420 12977 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.172439 13052 raft_consensus.cc:3032] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:37.172571 13052 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:37.172858 13052 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.173234 13052 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.175516 12977 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:37.175956 12868 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:37.175956 13052 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:37.176327 13132 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:37.176498 13132 raft_consensus.cc:686] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:37.176766 13132 consensus_queue.cc:237] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.179219 12799 catalog_manager.cc:5484] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 2 to 3, leader changed from c24788c795c748bd9b659828a72a0c10 (127.12.1.131) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 3 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:37.183049 13101 raft_consensus.cc:979] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.183194 13101 raft_consensus.cc:1067] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.183748 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50656
I20240503 14:12:37.183925 12902 raft_consensus.cc:482] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:37.184027 12902 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.185849 12902 raft_consensus.cc:504] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.186398 12902 leader_election.cc:288] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:37.186830 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:37.186889 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49d6e0b3a4246eea494bb39695802d1" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:37.187075 13052 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.187115 12977 raft_consensus.cc:3032] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:37.187201 12977 raft_consensus.cc:729] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:37.187490 12977 consensus_queue.cc:260] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.187858 12977 raft_consensus.cc:3037] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:37.190011 13052 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:37.190500 12977 raft_consensus.cc:2454] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 3.
I20240503 14:12:37.190903 12868 leader_election.cc:302] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:37.191182 13132 raft_consensus.cc:2781] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:37.191330 13132 raft_consensus.cc:686] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:37.191552 13132 consensus_queue.cc:237] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.194104 12799 catalog_manager.cc:5484] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 2 to 3, leader changed from 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 3 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:37.432897 13052 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.433491 13132 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.438093 12977 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.438827 13197 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.452469 13205 raft_consensus.cc:979] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: : Instructing follower fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.452628 13205 raft_consensus.cc:1067] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Signalling peer fdab8f8e993343c485b56bae234e8ee7 to start an election
I20240503 14:12:37.453222 12902 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "46068d8586354b728524308d8e52fd93"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
from {username='slave'} at 127.0.0.1:50656
I20240503 14:12:37.453401 12902 raft_consensus.cc:482] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:37.453518 12902 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:37.455401 12902 raft_consensus.cc:504] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.455953 12902 leader_election.cc:288] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Requested vote from peers 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:37.456337 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:37.456352 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46068d8586354b728524308d8e52fd93" candidate_uuid: "fdab8f8e993343c485b56bae234e8ee7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:37.456583 12977 raft_consensus.cc:3032] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Stepping down as leader of term 1
I20240503 14:12:37.456600 13052 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:37.456712 12977 raft_consensus.cc:729] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:37.456993 12977 consensus_queue.cc:260] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.457378 12977 raft_consensus.cc:3037] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:37.459656 13052 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:37.460301 12868 leader_election.cc:302] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:37.460577 13197 raft_consensus.cc:2781] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:37.460635 12977 raft_consensus.cc:2454] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fdab8f8e993343c485b56bae234e8ee7 in term 2.
I20240503 14:12:37.460729 13197 raft_consensus.cc:686] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Leader. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:37.461030 13197 consensus_queue.cc:237] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:37.463578 12799 catalog_manager.cc:5484] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 reported cstate change: term changed from 1 to 2, leader changed from 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130) to fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129). New cstate: current_term: 2 leader_uuid: "fdab8f8e993343c485b56bae234e8ee7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:37.594306 13052 raft_consensus.cc:1261] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.594997 13197 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.598645 12977 raft_consensus.cc:1261] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.599669 13132 consensus_queue.cc:1035] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.649570 13052 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.650215 13132 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.654057 12977 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:37.654639 13197 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:37.875872 13052 raft_consensus.cc:1261] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:37.876533 13197 consensus_queue.cc:1035] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:37.880729 12977 raft_consensus.cc:1261] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Refusing update from remote peer fdab8f8e993343c485b56bae234e8ee7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20240503 14:12:37.881680 13197 consensus_queue.cc:1035] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:39.993959 12294 auto_leader_rebalancer-test.cc:365] The leader distribution is
I20240503 14:12:39.994248 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:39.997051 12902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:50686
I20240503 14:12:39.997273 12902 raft_consensus.cc:595] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Received request to transfer leadership to TS 7b8c86089c0445f8a239c7d252e4fb56
I20240503 14:12:39.998235 12902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:50686
I20240503 14:12:39.998420 12902 raft_consensus.cc:595] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Received request to transfer leadership to TS 7b8c86089c0445f8a239c7d252e4fb56
I20240503 14:12:39.999787 12902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "69725f3063c14ca58725ccb35262d938"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:50686
I20240503 14:12:39.999958 12902 raft_consensus.cc:595] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Received request to transfer leadership to TS c24788c795c748bd9b659828a72a0c10
I20240503 14:12:40.000732 12902 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
mode: GRACEFUL
new_leader_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:50686
I20240503 14:12:40.000892 12902 raft_consensus.cc:595] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Received request to transfer leadership to TS c24788c795c748bd9b659828a72a0c10
I20240503 14:12:40.001226 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 4
I20240503 14:12:40.001412 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:40.163095 13197 raft_consensus.cc:979] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:40.163257 13197 raft_consensus.cc:1067] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Signalling peer c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:40.163825 13052 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:32960
I20240503 14:12:40.164031 13052 raft_consensus.cc:482] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:40.164121 13052 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.166575 13052 raft_consensus.cc:504] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.167244 13052 leader_election.cc:288] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 4 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:40.167626 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:40.167824 12902 raft_consensus.cc:3032] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 14:12:40.167896 12902 raft_consensus.cc:729] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:40.168102 12902 consensus_queue.cc:260] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.168349 12902 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.170222 12902 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 4.
I20240503 14:12:40.170188 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfe76f29026545c0afd116ddae18079f" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:40.170456 12977 raft_consensus.cc:3037] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.170689 13015 leader_election.cc:302] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c24788c795c748bd9b659828a72a0c10, fdab8f8e993343c485b56bae234e8ee7; no voters:
I20240503 14:12:40.171000 13198 raft_consensus.cc:2781] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:12:40.171566 13198 raft_consensus.cc:686] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 4 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:40.171963 13198 consensus_queue.cc:237] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.173771 12977 raft_consensus.cc:2454] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 4.
I20240503 14:12:40.176023 12799 catalog_manager.cc:5484] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 3 to 4, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 4 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:40.275976 13220 raft_consensus.cc:979] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:40.276135 13220 raft_consensus.cc:1067] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Signalling peer 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:40.276782 12977 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:40210
I20240503 14:12:40.276973 12977 raft_consensus.cc:482] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:40.277096 12977 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.279026 12977 raft_consensus.cc:504] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.279749 12977 leader_election.cc:288] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 4 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:40.280128 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:40.280257 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55c8a5eb6f2b43b48e00be66a1851aca" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:40.280370 12902 raft_consensus.cc:3032] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Stepping down as leader of term 3
I20240503 14:12:40.280457 13052 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.280468 12902 raft_consensus.cc:729] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:40.280792 12902 consensus_queue.cc:260] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.281185 12902 raft_consensus.cc:3037] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Advancing to term 4
I20240503 14:12:40.283396 13052 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 4.
I20240503 14:12:40.283876 12943 leader_election.cc:302] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:40.283900 12902 raft_consensus.cc:2454] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 4.
I20240503 14:12:40.284217 13205 raft_consensus.cc:2781] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Leader election won for term 4
I20240503 14:12:40.284616 13205 raft_consensus.cc:686] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:40.284893 13205 consensus_queue.cc:237] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.287338 12799 catalog_manager.cc:5484] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 3 to 4, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 4 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:40.366776 13197 raft_consensus.cc:979] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:40.366955 13197 raft_consensus.cc:1067] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Signalling peer 7b8c86089c0445f8a239c7d252e4fb56 to start an election
I20240503 14:12:40.367509 12977 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21"
dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
from {username='slave'} at 127.0.0.1:40210
I20240503 14:12:40.367723 12977 raft_consensus.cc:482] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:40.367838 12977 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.369832 12977 raft_consensus.cc:504] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.370466 12977 leader_election.cc:288] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 3 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), c24788c795c748bd9b659828a72a0c10 (127.12.1.131:35537)
I20240503 14:12:40.370930 13052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c24788c795c748bd9b659828a72a0c10"
I20240503 14:12:40.370930 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dccfc0cec774ef09118992553a68b21" candidate_uuid: "7b8c86089c0445f8a239c7d252e4fb56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:40.371198 13052 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.371222 12902 raft_consensus.cc:3032] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:40.371315 12902 raft_consensus.cc:729] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:40.371587 12902 consensus_queue.cc:260] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.371981 12902 raft_consensus.cc:3037] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.374184 13052 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 3.
I20240503 14:12:40.374612 12943 leader_election.cc:302] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:40.374702 12902 raft_consensus.cc:2454] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8c86089c0445f8a239c7d252e4fb56 in term 3.
I20240503 14:12:40.374945 13205 raft_consensus.cc:2781] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:40.375150 13205 raft_consensus.cc:686] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 LEADER]: Becoming Leader. State: Replica: 7b8c86089c0445f8a239c7d252e4fb56, State: Running, Role: LEADER
I20240503 14:12:40.375406 13205 consensus_queue.cc:237] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } }
I20240503 14:12:40.377871 12799 catalog_manager.cc:5484] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 reported cstate change: term changed from 2 to 3, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130). New cstate: current_term: 3 leader_uuid: "7b8c86089c0445f8a239c7d252e4fb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:40.558687 13220 raft_consensus.cc:979] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: : Instructing follower c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:40.558899 13220 raft_consensus.cc:1067] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Signalling peer c24788c795c748bd9b659828a72a0c10 to start an election
I20240503 14:12:40.559535 13052 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "69725f3063c14ca58725ccb35262d938"
dest_uuid: "c24788c795c748bd9b659828a72a0c10"
from {username='slave'} at 127.0.0.1:32960
I20240503 14:12:40.559746 13052 raft_consensus.cc:482] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20240503 14:12:40.559844 13052 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.562111 13052 raft_consensus.cc:504] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:40.562716 13052 leader_election.cc:288] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 3 election: Requested vote from peers fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423), 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615)
I20240503 14:12:40.563155 12902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fdab8f8e993343c485b56bae234e8ee7"
I20240503 14:12:40.563160 12977 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69725f3063c14ca58725ccb35262d938" candidate_uuid: "c24788c795c748bd9b659828a72a0c10" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b8c86089c0445f8a239c7d252e4fb56"
I20240503 14:12:40.563354 12902 raft_consensus.cc:3032] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Stepping down as leader of term 2
I20240503 14:12:40.563381 12977 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.563441 12902 raft_consensus.cc:729] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fdab8f8e993343c485b56bae234e8ee7, State: Running, Role: LEADER
I20240503 14:12:40.563715 12902 consensus_queue.cc:260] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:40.564018 12902 raft_consensus.cc:3037] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Advancing to term 3
I20240503 14:12:40.565536 12977 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 3.
I20240503 14:12:40.565912 13017 leader_election.cc:302] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8c86089c0445f8a239c7d252e4fb56, c24788c795c748bd9b659828a72a0c10; no voters:
I20240503 14:12:40.566035 12902 raft_consensus.cc:2454] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c24788c795c748bd9b659828a72a0c10 in term 3.
I20240503 14:12:40.566213 13198 raft_consensus.cc:2781] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Leader election won for term 3
I20240503 14:12:40.566365 13198 raft_consensus.cc:686] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 3 LEADER]: Becoming Leader. State: Replica: c24788c795c748bd9b659828a72a0c10, State: Running, Role: LEADER
I20240503 14:12:40.566646 13198 consensus_queue.cc:237] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } }
I20240503 14:12:40.569016 12799 catalog_manager.cc:5484] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 reported cstate change: term changed from 2 to 3, leader changed from fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129) to c24788c795c748bd9b659828a72a0c10 (127.12.1.131). New cstate: current_term: 3 leader_uuid: "c24788c795c748bd9b659828a72a0c10" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:40.614599 12977 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:40.615217 13198 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:40.619447 12902 raft_consensus.cc:1261] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:40.620148 13221 consensus_queue.cc:1035] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:40.882738 13052 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:40.883360 13205 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:40.887498 12902 raft_consensus.cc:1261] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20240503 14:12:40.888023 13237 consensus_queue.cc:1035] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:40.933077 13052 raft_consensus.cc:1261] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:40.933701 13237 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c24788c795c748bd9b659828a72a0c10" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 35537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:40.938867 12902 raft_consensus.cc:1261] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Refusing update from remote peer 7b8c86089c0445f8a239c7d252e4fb56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:40.939642 13237 consensus_queue.cc:1035] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:40.978030 12902 raft_consensus.cc:1261] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:40.978603 13221 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdab8f8e993343c485b56bae234e8ee7" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 39423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:40.982910 12977 raft_consensus.cc:1261] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Refusing update from remote peer c24788c795c748bd9b659828a72a0c10: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20240503 14:12:40.983456 13198 consensus_queue.cc:1035] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8c86089c0445f8a239c7d252e4fb56" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 40615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:41.001878 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:41.003619 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:41.003891 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:42.004251 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:42.005834 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:42.006021 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:43.006428 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:43.008121 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:43.008354 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:44.008747 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:44.010578 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:44.010739 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:45.011103 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:45.012663 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:45.012887 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:46.013240 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:46.015180 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:46.015341 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:47.015761 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:47.017783 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:47.018023 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:48.018538 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:48.021136 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:48.021339 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:49.021849 12294 auto_leader_rebalancer.cc:131] leader rebalance for table test-workload
I20240503 14:12:49.023600 12294 auto_leader_rebalancer.cc:379] table: test-workload, leader rebalance finish, leader transfer count: 0
I20240503 14:12:49.023865 12294 auto_leader_rebalancer.cc:437] All tables' leader rebalancing finished this round
I20240503 14:12:50.035683 12294 auto_leader_rebalancer-test.cc:376] The leader distribution is
I20240503 14:12:50.035916 12294 tablet_server.cc:178] TabletServer@127.12.1.129:0 shutting down...
I20240503 14:12:50.044612 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:50.044912 12294 tablet_replica.cc:330] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.045102 12294 raft_consensus.cc:2229] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.045297 12294 raft_consensus.cc:2258] T 55c8a5eb6f2b43b48e00be66a1851aca P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.045905 12294 tablet_replica.cc:330] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.046100 12294 raft_consensus.cc:2229] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.046397 12294 raft_consensus.cc:2258] T 46068d8586354b728524308d8e52fd93 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.046936 12294 tablet_replica.cc:330] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.047077 12294 raft_consensus.cc:2229] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.047336 12294 raft_consensus.cc:2258] T 5868cf4f957b4f45804b74e282452d3f P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.047787 12294 tablet_replica.cc:330] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.047941 12294 raft_consensus.cc:2229] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.048080 12294 raft_consensus.cc:2258] T cfe76f29026545c0afd116ddae18079f P fdab8f8e993343c485b56bae234e8ee7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.048509 12294 tablet_replica.cc:330] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.048645 12294 raft_consensus.cc:2229] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.048815 12294 raft_consensus.cc:2258] T 3dccfc0cec774ef09118992553a68b21 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.049223 12294 tablet_replica.cc:330] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.049366 12294 raft_consensus.cc:2229] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.049510 12294 raft_consensus.cc:2258] T b26b4408f0b04e90a99712df4760357d P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.049938 12294 tablet_replica.cc:330] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.050104 12294 raft_consensus.cc:2229] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 3 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.050364 12294 raft_consensus.cc:2258] T d49d6e0b3a4246eea494bb39695802d1 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.050792 12294 tablet_replica.cc:330] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.050932 12294 raft_consensus.cc:2229] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.051066 12294 raft_consensus.cc:2258] T 69725f3063c14ca58725ccb35262d938 P fdab8f8e993343c485b56bae234e8ee7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.051467 12294 tablet_replica.cc:330] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.051594 12294 raft_consensus.cc:2229] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.051741 12294 raft_consensus.cc:2258] T 88a07c09b2ed4e8cbe95b951d77d5465 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.052117 12294 tablet_replica.cc:330] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7: stopping tablet replica
I20240503 14:12:50.052253 12294 raft_consensus.cc:2229] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.052495 12294 raft_consensus.cc:2258] T 864a509fa7b243f4837c6d291174e726 P fdab8f8e993343c485b56bae234e8ee7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.069643 12294 tablet_server.cc:194] TabletServer@127.12.1.129:0 shutdown complete.
I20240503 14:12:50.082440 12294 tablet_server.cc:178] TabletServer@127.12.1.130:0 shutting down...
W20240503 14:12:50.088970 13017 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20240503 14:12:50.090754 13017 consensus_peers.cc:485] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 -> Peer 7b8c86089c0445f8a239c7d252e4fb56 (127.12.1.130:40615): Couldn't send request to peer 7b8c86089c0445f8a239c7d252e4fb56. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20240503 14:12:50.091215 13015 consensus_peers.cc:485] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 -> Peer fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423): Couldn't send request to peer fdab8f8e993343c485b56bae234e8ee7. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.129:39423: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:50.093586 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:50.093816 12294 tablet_replica.cc:330] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.094028 12294 raft_consensus.cc:2229] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.094206 12294 raft_consensus.cc:2258] T 69725f3063c14ca58725ccb35262d938 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.094797 12294 tablet_replica.cc:330] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.094929 12294 raft_consensus.cc:2229] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.095062 12294 raft_consensus.cc:2258] T 88a07c09b2ed4e8cbe95b951d77d5465 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.095517 12294 tablet_replica.cc:330] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.095643 12294 raft_consensus.cc:2229] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.095892 12294 raft_consensus.cc:2258] T 55c8a5eb6f2b43b48e00be66a1851aca P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.096287 12294 tablet_replica.cc:330] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.096410 12294 raft_consensus.cc:2229] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.096542 12294 raft_consensus.cc:2258] T 46068d8586354b728524308d8e52fd93 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.096925 12294 tablet_replica.cc:330] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.097035 12294 raft_consensus.cc:2229] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.097137 12294 raft_consensus.cc:2258] T 864a509fa7b243f4837c6d291174e726 P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.097477 12294 tablet_replica.cc:330] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.097569 12294 raft_consensus.cc:2229] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.097662 12294 raft_consensus.cc:2258] T cfe76f29026545c0afd116ddae18079f P 7b8c86089c0445f8a239c7d252e4fb56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.098016 12294 tablet_replica.cc:330] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.098134 12294 raft_consensus.cc:2229] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.098250 12294 raft_consensus.cc:2258] T 5868cf4f957b4f45804b74e282452d3f P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.098601 12294 tablet_replica.cc:330] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.098690 12294 raft_consensus.cc:2229] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.098904 12294 raft_consensus.cc:2258] T 3dccfc0cec774ef09118992553a68b21 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.099241 12294 tablet_replica.cc:330] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.099328 12294 raft_consensus.cc:2229] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.099423 12294 raft_consensus.cc:2258] T d49d6e0b3a4246eea494bb39695802d1 P 7b8c86089c0445f8a239c7d252e4fb56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.099742 12294 tablet_replica.cc:330] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56: stopping tablet replica
I20240503 14:12:50.099828 12294 raft_consensus.cc:2229] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.100034 12294 raft_consensus.cc:2258] T b26b4408f0b04e90a99712df4760357d P 7b8c86089c0445f8a239c7d252e4fb56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.115164 12294 tablet_server.cc:194] TabletServer@127.12.1.130:0 shutdown complete.
I20240503 14:12:50.119572 12294 tablet_server.cc:178] TabletServer@127.12.1.131:0 shutting down...
W20240503 14:12:50.122831 13015 consensus_peers.cc:485] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 -> Peer fdab8f8e993343c485b56bae234e8ee7 (127.12.1.129:39423): Couldn't send request to peer fdab8f8e993343c485b56bae234e8ee7. Status: Network error: Client connection negotiation failed: client connection to 127.12.1.129:39423: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:50.128538 12294 ts_tablet_manager.cc:1470] Shutting down tablet manager...
I20240503 14:12:50.128785 12294 tablet_replica.cc:330] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.128964 12294 raft_consensus.cc:2229] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.129138 12294 raft_consensus.cc:2258] T 55c8a5eb6f2b43b48e00be66a1851aca P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.129707 12294 tablet_replica.cc:330] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.129848 12294 raft_consensus.cc:2229] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 2 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.130152 12294 raft_consensus.cc:2258] T 88a07c09b2ed4e8cbe95b951d77d5465 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.130611 12294 tablet_replica.cc:330] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.130733 12294 raft_consensus.cc:2229] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.130854 12294 raft_consensus.cc:2258] T 46068d8586354b728524308d8e52fd93 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.131250 12294 tablet_replica.cc:330] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.131366 12294 raft_consensus.cc:2229] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.131500 12294 raft_consensus.cc:2258] T 5868cf4f957b4f45804b74e282452d3f P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.131883 12294 tablet_replica.cc:330] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.132009 12294 raft_consensus.cc:2229] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 4 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.132241 12294 raft_consensus.cc:2258] T cfe76f29026545c0afd116ddae18079f P c24788c795c748bd9b659828a72a0c10 [term 4 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.132638 12294 tablet_replica.cc:330] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.132756 12294 raft_consensus.cc:2229] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.132880 12294 raft_consensus.cc:2258] T 3dccfc0cec774ef09118992553a68b21 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.133282 12294 tablet_replica.cc:330] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.133394 12294 raft_consensus.cc:2229] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.133522 12294 raft_consensus.cc:2258] T b26b4408f0b04e90a99712df4760357d P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.133882 12294 tablet_replica.cc:330] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.134013 12294 raft_consensus.cc:2229] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.134147 12294 raft_consensus.cc:2258] T d49d6e0b3a4246eea494bb39695802d1 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.134532 12294 tablet_replica.cc:330] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.134640 12294 raft_consensus.cc:2229] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 3 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.134860 12294 raft_consensus.cc:2258] T 69725f3063c14ca58725ccb35262d938 P c24788c795c748bd9b659828a72a0c10 [term 3 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.135233 12294 tablet_replica.cc:330] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10: stopping tablet replica
I20240503 14:12:50.135339 12294 raft_consensus.cc:2229] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:50.135458 12294 raft_consensus.cc:2258] T 864a509fa7b243f4837c6d291174e726 P c24788c795c748bd9b659828a72a0c10 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.150636 12294 tablet_server.cc:194] TabletServer@127.12.1.131:0 shutdown complete.
I20240503 14:12:50.159973 12294 master.cc:537] Master@127.12.1.190:36563 shutting down...
I20240503 14:12:50.167258 12294 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 1 LEADER]: Raft consensus shutting down.
I20240503 14:12:50.167496 12294 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:50.167575 12294 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5a1c073104df4d3791fc29cf98d41caa: stopping tablet replica
I20240503 14:12:50.181540 12294 master.cc:552] Master@127.12.1.190:36563 shutdown complete.
7b8c86089c0445f8a239c7d252e4fb56 4
c24788c795c748bd9b659828a72a0c10 1
fdab8f8e993343c485b56bae234e8ee7 5
7b8c86089c0445f8a239c7d252e4fb56 3
c24788c795c748bd9b659828a72a0c10 3
fdab8f8e993343c485b56bae234e8ee7 4
7b8c86089c0445f8a239c7d252e4fb56 1
c24788c795c748bd9b659828a72a0c10 1
fdab8f8e993343c485b56bae234e8ee7 8
7b8c86089c0445f8a239c7d252e4fb56 3
c24788c795c748bd9b659828a72a0c10 3
fdab8f8e993343c485b56bae234e8ee7 4
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (27429 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20240503 14:12:50.203325 12294 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.12.1.190:35453
I20240503 14:12:50.203924 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:50.207254 13252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.208212 13253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.208956 13255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:50.209657 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:50.209925 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:50.209998 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:50.210040 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745570210035 us; error 0 us; skew 500 ppm
I20240503 14:12:50.210175 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:50.215373 12294 webserver.cc:460] Webserver started at http://127.12.1.190:36825/ using document root <none> and password file <none>
I20240503 14:12:50.215613 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:50.215669 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:50.215763 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:50.216522 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/master-0-root/instance:
uuid: "3d571e7b538f447b9ae2ad35125bdd26"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.219264 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20240503 14:12:50.220815 13260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.221153 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20240503 14:12:50.221244 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/master-0-root
uuid: "3d571e7b538f447b9ae2ad35125bdd26"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.221346 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:50.227398 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:50.227861 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:50.240514 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.190:35453
I20240503 14:12:50.240536 13311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.190:35453 every 8 connection(s)
I20240503 14:12:50.241765 13312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.246008 13312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26: Bootstrap starting.
I20240503 14:12:50.247352 13312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.248944 13312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26: No bootstrap required, opened a new log
I20240503 14:12:50.249543 13312 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER }
I20240503 14:12:50.249671 13312 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:50.249722 13312 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d571e7b538f447b9ae2ad35125bdd26, State: Initialized, Role: FOLLOWER
I20240503 14:12:50.249912 13312 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER }
I20240503 14:12:50.250064 13312 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240503 14:12:50.250120 13312 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240503 14:12:50.250186 13312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:50.251971 13312 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER }
I20240503 14:12:50.252154 13312 leader_election.cc:302] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d571e7b538f447b9ae2ad35125bdd26; no voters:
I20240503 14:12:50.252518 13312 leader_election.cc:288] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240503 14:12:50.252631 13315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:50.253051 13315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [term 1 LEADER]: Becoming Leader. State: Replica: 3d571e7b538f447b9ae2ad35125bdd26, State: Running, Role: LEADER
I20240503 14:12:50.253298 13312 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [sys.catalog]: configured and running, proceeding with master startup.
I20240503 14:12:50.253283 13315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER }
I20240503 14:12:50.254333 13316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d571e7b538f447b9ae2ad35125bdd26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER } }
I20240503 14:12:50.254357 13317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d571e7b538f447b9ae2ad35125bdd26. Latest consensus state: current_term: 1 leader_uuid: "3d571e7b538f447b9ae2ad35125bdd26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d571e7b538f447b9ae2ad35125bdd26" member_type: VOTER } }
I20240503 14:12:50.254609 13317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [sys.catalog]: This master's current role is: LEADER
I20240503 14:12:50.255084 13316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26 [sys.catalog]: This master's current role is: LEADER
I20240503 14:12:50.255493 13321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240503 14:12:50.257344 13321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240503 14:12:50.258203 12294 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20240503 14:12:50.260272 13321 catalog_manager.cc:1347] Generated new cluster ID: 18239886b7eb4e9dbad98ea60dfd37e1
I20240503 14:12:50.260334 13321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240503 14:12:50.273087 13321 catalog_manager.cc:1370] Generated new certificate authority record
I20240503 14:12:50.273866 13321 catalog_manager.cc:1504] Loading token signing keys...
I20240503 14:12:50.283646 13321 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 3d571e7b538f447b9ae2ad35125bdd26: Generated new TSK 0
I20240503 14:12:50.283875 13321 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240503 14:12:50.290714 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:50.294112 13333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.294697 13334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.295504 13336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:50.296274 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:50.296514 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:50.296568 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:50.296603 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745570296600 us; error 0 us; skew 500 ppm
I20240503 14:12:50.296734 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:50.297922 12294 webserver.cc:460] Webserver started at http://127.12.1.129:42265/ using document root <none> and password file <none>
I20240503 14:12:50.298180 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:50.298249 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:50.298367 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:50.298992 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/instance:
uuid: "7fac721f53074af6930b046ab54bb83f"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.301333 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20240503 14:12:50.302806 13341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.303123 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:50.303218 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root
uuid: "7fac721f53074af6930b046ab54bb83f"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.303318 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:50.325342 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:50.325891 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:50.326529 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:50.327375 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:50.327431 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.327486 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:50.327524 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.340274 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.129:38667
I20240503 14:12:50.340304 13403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.129:38667 every 8 connection(s)
I20240503 14:12:50.341801 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:50.345376 13408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.346223 13409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.346803 13411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:50.347330 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:50.347661 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:50.347728 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:50.347761 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745570347758 us; error 0 us; skew 500 ppm
I20240503 14:12:50.347898 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:50.348294 13404 heartbeater.cc:347] Connected to a master server at 127.12.1.190:35453
I20240503 14:12:50.348414 13404 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:50.348954 13404 heartbeater.cc:511] Master 127.12.1.190:35453 requested a full tablet report, sending...
I20240503 14:12:50.349225 12294 webserver.cc:460] Webserver started at http://127.12.1.130:35279/ using document root <none> and password file <none>
I20240503 14:12:50.349419 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:50.349484 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:50.349603 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:50.349967 13277 ts_manager.cc:194] Registered new tserver with Master: 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667)
I20240503 14:12:50.350262 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/instance:
uuid: "16559a1767cd4197b59673a1a99035a8"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.351063 13277 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59234
I20240503 14:12:50.352604 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:50.354149 13416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.354517 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:50.354616 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root
uuid: "16559a1767cd4197b59673a1a99035a8"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.354713 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:50.360697 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:50.361166 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:50.361622 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:50.362438 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:50.362493 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.362541 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:50.362571 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.374451 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.130:43439
I20240503 14:12:50.374480 13478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.130:43439 every 8 connection(s)
I20240503 14:12:50.375931 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:50.380009 13482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:50.380478 13483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:50.382747 12294 server_base.cc:1034] running on GCE node
W20240503 14:12:50.383186 13485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:50.383553 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:50.383631 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:50.383661 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745570383657 us; error 0 us; skew 500 ppm
I20240503 14:12:50.383800 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:50.383818 13479 heartbeater.cc:347] Connected to a master server at 127.12.1.190:35453
I20240503 14:12:50.383926 13479 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:50.384301 13479 heartbeater.cc:511] Master 127.12.1.190:35453 requested a full tablet report, sending...
I20240503 14:12:50.385138 12294 webserver.cc:460] Webserver started at http://127.12.1.131:33559/ using document root <none> and password file <none>
I20240503 14:12:50.385241 13277 ts_manager.cc:194] Registered new tserver with Master: 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:50.385334 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:50.385401 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:50.385504 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:50.386049 13277 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59246
I20240503 14:12:50.386138 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/instance:
uuid: "91066aa139a64459b70c70e9d02fe3e1"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.388507 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:50.389914 13490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.390254 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:50.390342 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root
uuid: "91066aa139a64459b70c70e9d02fe3e1"
format_stamp: "Formatted at 2024-05-03 14:12:50 on dist-test-slave-6fwv"
I20240503 14:12:50.390439 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:50.400377 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:50.400861 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:50.401357 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:50.402176 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:50.402230 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.402312 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:50.402346 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:50.415763 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.131:34815
I20240503 14:12:50.415787 13552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.131:34815 every 8 connection(s)
I20240503 14:12:50.422148 13553 heartbeater.cc:347] Connected to a master server at 127.12.1.190:35453
I20240503 14:12:50.422297 13553 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:50.422657 13553 heartbeater.cc:511] Master 127.12.1.190:35453 requested a full tablet report, sending...
I20240503 14:12:50.423494 13277 ts_manager.cc:194] Registered new tserver with Master: 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:50.424186 13277 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59256
I20240503 14:12:50.424475 12294 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007890864s
I20240503 14:12:50.426036 12294 test_util.cc:268] Using random seed: 1352334513
I20240503 14:12:50.436558 13277 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59268:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20240503 14:12:50.437846 13277 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240503 14:12:50.503437 13517 tablet_service.cc:1467] Processing CreateTablet for tablet dc278b18dbe543c797160688d0d08403 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 14:12:50.503651 13369 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 14:12:50.503854 13510 tablet_service.cc:1467] Processing CreateTablet for tablet 514eb3d2023740edb111da5cc6b6de35 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 14:12:50.504010 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc278b18dbe543c797160688d0d08403. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.504074 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.504249 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514eb3d2023740edb111da5cc6b6de35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.506292 13515 tablet_service.cc:1467] Processing CreateTablet for tablet cbff04261a5a4f37a39b9e0a8dada8aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 14:12:50.506721 13515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbff04261a5a4f37a39b9e0a8dada8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.510387 13518 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 14:12:50.510704 13513 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2156b9064a4e6d972b5a10af68bada (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 14:12:50.510387 13514 tablet_service.cc:1467] Processing CreateTablet for tablet ddb2aad6a2524734ad7fb9067db7372c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 14:12:50.503453 13516 tablet_service.cc:1467] Processing CreateTablet for tablet 97f96b0aa5024991b4ad009c8c1393ec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 14:12:50.511296 13512 tablet_service.cc:1467] Processing CreateTablet for tablet 325462c18cf14226ac695fcb5f0463c3 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 14:12:50.510826 13518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.511379 13367 tablet_service.cc:1467] Processing CreateTablet for tablet 97f96b0aa5024991b4ad009c8c1393ec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 14:12:50.511658 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325462c18cf14226ac695fcb5f0463c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.511824 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f96b0aa5024991b4ad009c8c1393ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.514343 13511 tablet_service.cc:1467] Processing CreateTablet for tablet 11392c75b3284fa892b06d7e83b09aa2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 14:12:50.514737 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11392c75b3284fa892b06d7e83b09aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.514645 13442 tablet_service.cc:1467] Processing CreateTablet for tablet 97f96b0aa5024991b4ad009c8c1393ec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20240503 14:12:50.515017 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f96b0aa5024991b4ad009c8c1393ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.518333 13509 tablet_service.cc:1467] Processing CreateTablet for tablet 49bed4cea1814a33870695d2a9c8ba9b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 14:12:50.518710 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bed4cea1814a33870695d2a9c8ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.518743 13438 tablet_service.cc:1467] Processing CreateTablet for tablet 325462c18cf14226ac695fcb5f0463c3 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 14:12:50.518782 13367 tablet_service.cc:1467] Processing CreateTablet for tablet cbff04261a5a4f37a39b9e0a8dada8aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 14:12:50.519088 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325462c18cf14226ac695fcb5f0463c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.519153 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbff04261a5a4f37a39b9e0a8dada8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.522059 13366 tablet_service.cc:1467] Processing CreateTablet for tablet ddb2aad6a2524734ad7fb9067db7372c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 14:12:50.522284 13368 tablet_service.cc:1467] Processing CreateTablet for tablet dc278b18dbe543c797160688d0d08403 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 14:12:50.522516 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb2aad6a2524734ad7fb9067db7372c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.522576 13435 tablet_service.cc:1467] Processing CreateTablet for tablet 49bed4cea1814a33870695d2a9c8ba9b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 14:12:50.522679 13368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc278b18dbe543c797160688d0d08403. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.522886 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bed4cea1814a33870695d2a9c8ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.522284 13436 tablet_service.cc:1467] Processing CreateTablet for tablet 514eb3d2023740edb111da5cc6b6de35 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 14:12:50.523699 13443 tablet_service.cc:1467] Processing CreateTablet for tablet dc278b18dbe543c797160688d0d08403 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20240503 14:12:50.523902 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514eb3d2023740edb111da5cc6b6de35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.524231 13441 tablet_service.cc:1467] Processing CreateTablet for tablet cbff04261a5a4f37a39b9e0a8dada8aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20240503 14:12:50.524605 13441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cbff04261a5a4f37a39b9e0a8dada8aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.518309 13440 tablet_service.cc:1467] Processing CreateTablet for tablet ddb2aad6a2524734ad7fb9067db7372c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20240503 14:12:50.526278 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb2aad6a2524734ad7fb9067db7372c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.527459 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ddb2aad6a2524734ad7fb9067db7372c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.528379 13365 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2156b9064a4e6d972b5a10af68bada (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 14:12:50.528764 13365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2156b9064a4e6d972b5a10af68bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.529644 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f96b0aa5024991b4ad009c8c1393ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.514343 13444 tablet_service.cc:1467] Processing CreateTablet for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20240503 14:12:50.531244 13517 tablet_service.cc:1467] Processing CreateTablet for tablet b61dac9e02af42bf90fe1c8d9409b022 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 14:12:50.533614 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc278b18dbe543c797160688d0d08403. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.534031 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2156b9064a4e6d972b5a10af68bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.534653 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61dac9e02af42bf90fe1c8d9409b022. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.535552 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 11392c75b3284fa892b06d7e83b09aa2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 14:12:50.535784 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ca7f69e4b2f4cf3a9c5e262606c8960. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.535944 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11392c75b3284fa892b06d7e83b09aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.535552 13437 tablet_service.cc:1467] Processing CreateTablet for tablet 11392c75b3284fa892b06d7e83b09aa2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20240503 14:12:50.539026 13437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11392c75b3284fa892b06d7e83b09aa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.545058 13439 tablet_service.cc:1467] Processing CreateTablet for tablet 8d2156b9064a4e6d972b5a10af68bada (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20240503 14:12:50.545562 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d2156b9064a4e6d972b5a10af68bada. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.551532 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 49bed4cea1814a33870695d2a9c8ba9b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20240503 14:12:50.554505 13360 tablet_service.cc:1467] Processing CreateTablet for tablet b61dac9e02af42bf90fe1c8d9409b022 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 14:12:50.557483 13364 tablet_service.cc:1467] Processing CreateTablet for tablet 325462c18cf14226ac695fcb5f0463c3 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20240503 14:12:50.559940 13362 tablet_service.cc:1467] Processing CreateTablet for tablet 514eb3d2023740edb111da5cc6b6de35 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20240503 14:12:50.560113 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 325462c18cf14226ac695fcb5f0463c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.561556 13360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61dac9e02af42bf90fe1c8d9409b022. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.562206 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514eb3d2023740edb111da5cc6b6de35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.562799 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49bed4cea1814a33870695d2a9c8ba9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.564631 13366 tablet_service.cc:1467] Processing CreateTablet for tablet 1b5a9a77ea47412ab97fc72dc71ae785 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 14:12:50.565049 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b5a9a77ea47412ab97fc72dc71ae785. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.573776 13366 tablet_service.cc:1467] Processing CreateTablet for tablet 6f4aea14dec54042ab565a0bf2ec4a8b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 14:12:50.574712 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f4aea14dec54042ab565a0bf2ec4a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.574257 13363 tablet_service.cc:1467] Processing CreateTablet for tablet bb256c58a6714ec0be5fb71b9ffb121d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 14:12:50.578356 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb256c58a6714ec0be5fb71b9ffb121d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.580693 13438 tablet_service.cc:1467] Processing CreateTablet for tablet b61dac9e02af42bf90fe1c8d9409b022 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20240503 14:12:50.581131 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b61dac9e02af42bf90fe1c8d9409b022. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.581383 13569 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:50.581565 13510 tablet_service.cc:1467] Processing CreateTablet for tablet bb256c58a6714ec0be5fb71b9ffb121d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 14:12:50.582067 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb256c58a6714ec0be5fb71b9ffb121d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.590659 13518 tablet_service.cc:1467] Processing CreateTablet for tablet 1b5a9a77ea47412ab97fc72dc71ae785 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 14:12:50.591207 13518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b5a9a77ea47412ab97fc72dc71ae785. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.592818 13435 tablet_service.cc:1467] Processing CreateTablet for tablet bb256c58a6714ec0be5fb71b9ffb121d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20240503 14:12:50.594002 13369 tablet_service.cc:1467] Processing CreateTablet for tablet f69eeea0d62e4e68abeccb65c95a8dd8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 14:12:50.594550 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f69eeea0d62e4e68abeccb65c95a8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.603379 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb256c58a6714ec0be5fb71b9ffb121d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.606738 13569 tablet_bootstrap.cc:654] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.611326 13509 tablet_service.cc:1467] Processing CreateTablet for tablet 6f4aea14dec54042ab565a0bf2ec4a8b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 14:12:50.615814 13513 tablet_service.cc:1467] Processing CreateTablet for tablet f69eeea0d62e4e68abeccb65c95a8dd8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 14:12:50.617143 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f4aea14dec54042ab565a0bf2ec4a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.618257 13441 tablet_service.cc:1467] Processing CreateTablet for tablet 1b5a9a77ea47412ab97fc72dc71ae785 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20240503 14:12:50.622401 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f69eeea0d62e4e68abeccb65c95a8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.623505 13568 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:50.623607 13511 tablet_service.cc:1467] Processing CreateTablet for tablet ba6a0edf6cd84b4989c9a549936bb5aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 14:12:50.623637 13436 tablet_service.cc:1467] Processing CreateTablet for tablet f69eeea0d62e4e68abeccb65c95a8dd8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20240503 14:12:50.625272 13441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b5a9a77ea47412ab97fc72dc71ae785. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.625939 13367 tablet_service.cc:1467] Processing CreateTablet for tablet ba6a0edf6cd84b4989c9a549936bb5aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 14:12:50.627969 13442 tablet_service.cc:1467] Processing CreateTablet for tablet 6f4aea14dec54042ab565a0bf2ec4a8b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20240503 14:12:50.633646 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba6a0edf6cd84b4989c9a549936bb5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.633889 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba6a0edf6cd84b4989c9a549936bb5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.634115 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f69eeea0d62e4e68abeccb65c95a8dd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.639854 13570 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:50.639945 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f4aea14dec54042ab565a0bf2ec4a8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.640949 13439 tablet_service.cc:1467] Processing CreateTablet for tablet ba6a0edf6cd84b4989c9a549936bb5aa (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20240503 14:12:50.640925 13514 tablet_service.cc:1467] Processing CreateTablet for tablet 0008a5823a8f40d2ba13be37a59f4250 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 14:12:50.644744 13512 tablet_service.cc:1467] Processing CreateTablet for tablet de013d0b1c964223939e190d1ada54cd (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 14:12:50.645175 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008a5823a8f40d2ba13be37a59f4250. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.645364 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba6a0edf6cd84b4989c9a549936bb5aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.647025 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 0008a5823a8f40d2ba13be37a59f4250 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 14:12:50.652172 13365 tablet_service.cc:1467] Processing CreateTablet for tablet 0008a5823a8f40d2ba13be37a59f4250 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20240503 14:12:50.653199 13516 tablet_service.cc:1467] Processing CreateTablet for tablet e7bd97becb1b48589913cf52da1ab41d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 14:12:50.653203 13515 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 14:12:50.654173 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008a5823a8f40d2ba13be37a59f4250. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.655241 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de013d0b1c964223939e190d1ada54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.656754 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7bd97becb1b48589913cf52da1ab41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.656975 13515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.657356 13363 tablet_service.cc:1467] Processing CreateTablet for tablet de013d0b1c964223939e190d1ada54cd (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 14:12:50.658267 13365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0008a5823a8f40d2ba13be37a59f4250. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.658695 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de013d0b1c964223939e190d1ada54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.663574 13568 tablet_bootstrap.cc:654] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.678377 13440 tablet_service.cc:1467] Processing CreateTablet for tablet de013d0b1c964223939e190d1ada54cd (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20240503 14:12:50.682890 13510 tablet_service.cc:1467] Processing CreateTablet for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 14:12:50.683436 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de013d0b1c964223939e190d1ada54cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.686292 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.686172 13368 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 14:12:50.688176 13366 tablet_service.cc:1467] Processing CreateTablet for tablet e7bd97becb1b48589913cf52da1ab41d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 14:12:50.689142 13444 tablet_service.cc:1467] Processing CreateTablet for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20240503 14:12:50.689688 13368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.691776 13438 tablet_service.cc:1467] Processing CreateTablet for tablet e7bd97becb1b48589913cf52da1ab41d (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20240503 14:12:50.692603 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7bd97becb1b48589913cf52da1ab41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.693527 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1f84c6ec1d449f591d23ccf8b6d9a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.694720 13362 tablet_service.cc:1467] Processing CreateTablet for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 14:12:50.695642 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7bd97becb1b48589913cf52da1ab41d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.698179 13513 tablet_service.cc:1467] Processing CreateTablet for tablet 44014ff0028742f6a0241f820367cae0 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 14:12:50.698608 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44014ff0028742f6a0241f820367cae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.698858 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.704157 13569 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:50.704355 13569 ts_tablet_manager.cc:1367] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.123s user 0.015s sys 0.024s
I20240503 14:12:50.704849 13570 tablet_bootstrap.cc:654] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.711442 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 44014ff0028742f6a0241f820367cae0 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 14:12:50.719588 13364 tablet_service.cc:1467] Processing CreateTablet for tablet fec024e5ae7c43ebac0fb6f813701797 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 14:12:50.720779 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44014ff0028742f6a0241f820367cae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.724857 13360 tablet_service.cc:1467] Processing CreateTablet for tablet ee5723bf5c86432d9320810b098874f2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 14:12:50.727231 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fec024e5ae7c43ebac0fb6f813701797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.729103 13443 tablet_service.cc:1467] Processing CreateTablet for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20240503 14:12:50.730242 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcefb8b7ac4f4a9cad6b9fa6cc81f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.731513 13360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee5723bf5c86432d9320810b098874f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.735473 13511 tablet_service.cc:1467] Processing CreateTablet for tablet ee5723bf5c86432d9320810b098874f2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 14:12:50.736037 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee5723bf5c86432d9320810b098874f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.737483 13437 tablet_service.cc:1467] Processing CreateTablet for tablet 44014ff0028742f6a0241f820367cae0 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20240503 14:12:50.738117 13569 raft_consensus.cc:348] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.738243 13516 tablet_service.cc:1467] Processing CreateTablet for tablet b2b65a06703c4e309a69e11211909f8f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 14:12:50.738377 13569 raft_consensus.cc:374] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:50.738552 13569 raft_consensus.cc:729] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:50.738752 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b65a06703c4e309a69e11211909f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.738858 13569 consensus_queue.cc:260] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.739166 13512 tablet_service.cc:1467] Processing CreateTablet for tablet fec024e5ae7c43ebac0fb6f813701797 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 14:12:50.739216 13436 tablet_service.cc:1467] Processing CreateTablet for tablet fec024e5ae7c43ebac0fb6f813701797 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20240503 14:12:50.739274 13435 tablet_service.cc:1467] Processing CreateTablet for tablet ee5723bf5c86432d9320810b098874f2 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20240503 14:12:50.739521 13517 tablet_service.cc:1467] Processing CreateTablet for tablet b8fb295127b54943a2971e2a30a59d74 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 14:12:50.739802 13439 tablet_service.cc:1467] Processing CreateTablet for tablet b8fb295127b54943a2971e2a30a59d74 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 14:12:50.739708 13509 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1f8fbaaef34325ab780e134bcd9d6b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 14:12:50.739750 13369 tablet_service.cc:1467] Processing CreateTablet for tablet b8fb295127b54943a2971e2a30a59d74 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20240503 14:12:50.740581 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fb295127b54943a2971e2a30a59d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.740808 13437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 44014ff0028742f6a0241f820367cae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.742724 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fec024e5ae7c43ebac0fb6f813701797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.748698 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fec024e5ae7c43ebac0fb6f813701797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.751055 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee5723bf5c86432d9320810b098874f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.755235 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fb295127b54943a2971e2a30a59d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.760087 13518 tablet_service.cc:1467] Processing CreateTablet for tablet 82d492b984954755969aedb2c1bf7eda (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 14:12:50.764652 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1f8fbaaef34325ab780e134bcd9d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.765302 13569 ts_tablet_manager.cc:1398] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.061s user 0.016s sys 0.008s
I20240503 14:12:50.765735 13553 heartbeater.cc:503] Master 127.12.1.190:35453 was elected leader, sending a full tablet report...
I20240503 14:12:50.766361 13569 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:50.766968 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1f8fbaaef34325ab780e134bcd9d6b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 14:12:50.767526 13518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d492b984954755969aedb2c1bf7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.767764 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8fb295127b54943a2971e2a30a59d74. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.771636 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1f8fbaaef34325ab780e134bcd9d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.776476 13568 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:50.781100 13568 ts_tablet_manager.cc:1367] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.165s user 0.021s sys 0.022s
I20240503 14:12:50.781278 13365 tablet_service.cc:1467] Processing CreateTablet for tablet b2b65a06703c4e309a69e11211909f8f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 14:12:50.787675 13365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b65a06703c4e309a69e11211909f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.789081 13514 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec3306783ad4c918421e3ae57924197 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 14:12:50.789508 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec3306783ad4c918421e3ae57924197. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.795095 13441 tablet_service.cc:1467] Processing CreateTablet for tablet 3d1f8fbaaef34325ab780e134bcd9d6b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20240503 14:12:50.799146 13441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d1f8fbaaef34325ab780e134bcd9d6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.802701 13442 tablet_service.cc:1467] Processing CreateTablet for tablet b2b65a06703c4e309a69e11211909f8f (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20240503 14:12:50.806058 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2b65a06703c4e309a69e11211909f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.807219 13515 tablet_service.cc:1467] Processing CreateTablet for tablet a85fc6b00d9f4d6e8143448310037622 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 14:12:50.808020 13568 raft_consensus.cc:348] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:50.809314 13515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a85fc6b00d9f4d6e8143448310037622. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.812104 13568 raft_consensus.cc:374] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:50.816838 13570 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:50.817062 13570 ts_tablet_manager.cc:1367] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.192s user 0.003s sys 0.027s
I20240503 14:12:50.817905 13367 tablet_service.cc:1467] Processing CreateTablet for tablet 82d492b984954755969aedb2c1bf7eda (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 14:12:50.818699 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d492b984954755969aedb2c1bf7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.826804 13568 raft_consensus.cc:729] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:50.828830 13360 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec3306783ad4c918421e3ae57924197 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 14:12:50.829389 13360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec3306783ad4c918421e3ae57924197. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.830726 13444 tablet_service.cc:1467] Processing CreateTablet for tablet 82d492b984954755969aedb2c1bf7eda (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20240503 14:12:50.832938 13569 tablet_bootstrap.cc:654] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.834084 13361 tablet_service.cc:1467] Processing CreateTablet for tablet a85fc6b00d9f4d6e8143448310037622 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 14:12:50.834496 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a85fc6b00d9f4d6e8143448310037622. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.830322 13568 consensus_queue.cc:260] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:50.835355 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82d492b984954755969aedb2c1bf7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.838171 13368 tablet_service.cc:1467] Processing CreateTablet for tablet 846afe766b12483fb24acc12a1c88d3e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 14:12:50.841620 13570 raft_consensus.cc:348] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.841884 13570 raft_consensus.cc:374] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:50.843578 13368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846afe766b12483fb24acc12a1c88d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.841230 13511 tablet_service.cc:1467] Processing CreateTablet for tablet 846afe766b12483fb24acc12a1c88d3e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 14:12:50.847419 13362 tablet_service.cc:1467] Processing CreateTablet for tablet a78128a31c0c4c888cf6c49d6c39c205 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 14:12:50.847954 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78128a31c0c4c888cf6c49d6c39c205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.848078 13570 raft_consensus.cc:729] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:50.850078 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846afe766b12483fb24acc12a1c88d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.853286 13570 consensus_queue.cc:260] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.856762 13438 tablet_service.cc:1467] Processing CreateTablet for tablet 3ec3306783ad4c918421e3ae57924197 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20240503 14:12:50.861613 13573 raft_consensus.cc:482] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:50.862555 13366 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff759f510546409387dfd2383ec352 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 14:12:50.864805 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ec3306783ad4c918421e3ae57924197. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.870263 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff759f510546409387dfd2383ec352. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.869606 13573 raft_consensus.cc:504] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.882133 13570 ts_tablet_manager.cc:1398] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.059s user 0.004s sys 0.012s
I20240503 14:12:50.882004 13510 tablet_service.cc:1467] Processing CreateTablet for tablet a78128a31c0c4c888cf6c49d6c39c205 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 14:12:50.882365 13479 heartbeater.cc:503] Master 127.12.1.190:35453 was elected leader, sending a full tablet report...
I20240503 14:12:50.882592 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78128a31c0c4c888cf6c49d6c39c205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.882573 13516 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff759f510546409387dfd2383ec352 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 14:12:50.882045 13573 leader_election.cc:288] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:50.882028 13440 tablet_service.cc:1467] Processing CreateTablet for tablet a85fc6b00d9f4d6e8143448310037622 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20240503 14:12:50.883793 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a85fc6b00d9f4d6e8143448310037622. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.884253 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff759f510546409387dfd2383ec352. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.886376 13568 ts_tablet_manager.cc:1398] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.086s user 0.027s sys 0.002s
W20240503 14:12:50.882066 13480 tablet.cc:2369] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240503 14:12:50.886834 13404 heartbeater.cc:503] Master 127.12.1.190:35453 was elected leader, sending a full tablet report...
I20240503 14:12:50.887336 13437 tablet_service.cc:1467] Processing CreateTablet for tablet 846afe766b12483fb24acc12a1c88d3e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20240503 14:12:50.887671 13437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 846afe766b12483fb24acc12a1c88d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.895087 13569 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:50.895289 13569 ts_tablet_manager.cc:1367] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.130s user 0.004s sys 0.004s
I20240503 14:12:50.896524 13570 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:50.899459 13513 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ec02d284e1592683bfa6f9e4ae7 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 14:12:50.901955 13364 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ec02d284e1592683bfa6f9e4ae7 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 14:12:50.902449 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ec02d284e1592683bfa6f9e4ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.902755 13436 tablet_service.cc:1467] Processing CreateTablet for tablet a78128a31c0c4c888cf6c49d6c39c205 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20240503 14:12:50.903064 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a78128a31c0c4c888cf6c49d6c39c205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.904054 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ec02d284e1592683bfa6f9e4ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.904414 13568 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:50.926430 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 96ff759f510546409387dfd2383ec352 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20240503 14:12:50.926946 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96ff759f510546409387dfd2383ec352. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.927783 13509 tablet_service.cc:1467] Processing CreateTablet for tablet 19240561f76443c4b24b30ead79fc478 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 14:12:50.928172 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19240561f76443c4b24b30ead79fc478. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.932260 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfb820527284be694af068e5c804906 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 14:12:50.932705 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfb820527284be694af068e5c804906. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.932260 13515 tablet_service.cc:1467] Processing CreateTablet for tablet b04c12317b434827849e93569eb4e50c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 14:12:50.919515 13569 raft_consensus.cc:348] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.935886 13569 raft_consensus.cc:374] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:50.936014 13569 raft_consensus.cc:729] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:50.936497 13570 tablet_bootstrap.cc:654] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.936961 13511 tablet_service.cc:1467] Processing CreateTablet for tablet 560d40e7c91846f6a02539f867cb7431 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 14:12:50.937377 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 560d40e7c91846f6a02539f867cb7431. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.939127 13575 raft_consensus.cc:482] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:50.939251 13575 raft_consensus.cc:504] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:50.939527 13515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04c12317b434827849e93569eb4e50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.941157 13365 tablet_service.cc:1467] Processing CreateTablet for tablet b04c12317b434827849e93569eb4e50c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 14:12:50.941955 13365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04c12317b434827849e93569eb4e50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.942039 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 19240561f76443c4b24b30ead79fc478 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 14:12:50.943058 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19240561f76443c4b24b30ead79fc478. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.944763 13512 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7e006f0efc4a83b450a01b1166291c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 14:12:50.945667 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfb820527284be694af068e5c804906 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 14:12:50.946071 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfb820527284be694af068e5c804906. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.951313 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d7e006f0efc4a83b450a01b1166291c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.953255 13569 consensus_queue.cc:260] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.958954 13369 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7e006f0efc4a83b450a01b1166291c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 14:12:50.960397 13362 tablet_service.cc:1467] Processing CreateTablet for tablet 7d44249041c74ca48414ad2c6ca44ff8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 14:12:50.960458 13444 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ec02d284e1592683bfa6f9e4ae7 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20240503 14:12:50.960867 13569 ts_tablet_manager.cc:1398] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.066s user 0.001s sys 0.001s
I20240503 14:12:50.961110 13569 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:50.962458 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:50.963505 13435 tablet_service.cc:1467] Processing CreateTablet for tablet b04c12317b434827849e93569eb4e50c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20240503 14:12:50.963907 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b04c12317b434827849e93569eb4e50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.964949 13368 tablet_service.cc:1467] Processing CreateTablet for tablet 560d40e7c91846f6a02539f867cb7431 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 14:12:50.965680 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ec02d284e1592683bfa6f9e4ae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.965935 13569 tablet_bootstrap.cc:654] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.967057 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:50.968111 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d7e006f0efc4a83b450a01b1166291c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.968353 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d44249041c74ca48414ad2c6ca44ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.968633 13518 tablet_service.cc:1467] Processing CreateTablet for tablet 7d44249041c74ca48414ad2c6ca44ff8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 14:12:50.968891 13575 leader_election.cc:288] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:50.969049 13518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d44249041c74ca48414ad2c6ca44ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.969352 13368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 560d40e7c91846f6a02539f867cb7431. 1 dirs total, 0 dirs full, 0 dirs failed
W20240503 14:12:50.969553 13493 leader_election.cc:341] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:50.970116 13441 tablet_service.cc:1467] Processing CreateTablet for tablet 560d40e7c91846f6a02539f867cb7431 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20240503 14:12:50.970815 13440 tablet_service.cc:1467] Processing CreateTablet for tablet 1dfb820527284be694af068e5c804906 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20240503 14:12:50.973021 13441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 560d40e7c91846f6a02539f867cb7431. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.973603 13363 tablet_service.cc:1467] Processing CreateTablet for tablet fa59a1a71e92475eb287f0cdf7558884 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20240503 14:12:50.974020 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa59a1a71e92475eb287f0cdf7558884. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.974165 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1dfb820527284be694af068e5c804906. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.977708 13509 tablet_service.cc:1467] Processing CreateTablet for tablet e32b84c7de40447b8d01baa8385c7817 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 14:12:50.978108 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b84c7de40447b8d01baa8385c7817. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.979411 13442 tablet_service.cc:1467] Processing CreateTablet for tablet 19240561f76443c4b24b30ead79fc478 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20240503 14:12:50.979836 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19240561f76443c4b24b30ead79fc478. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.980582 13367 tablet_service.cc:1467] Processing CreateTablet for tablet e32b84c7de40447b8d01baa8385c7817 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 14:12:50.980968 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b84c7de40447b8d01baa8385c7817. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.981886 13568 tablet_bootstrap.cc:654] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:50.984467 13439 tablet_service.cc:1467] Processing CreateTablet for tablet fa59a1a71e92475eb287f0cdf7558884 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20240503 14:12:50.985818 13493 leader_election.cc:341] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:50.986021 13493 leader_election.cc:302] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:50.986303 13573 raft_consensus.cc:2726] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:50.986833 13438 tablet_service.cc:1467] Processing CreateTablet for tablet 5d7e006f0efc4a83b450a01b1166291c (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20240503 14:12:50.987224 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d7e006f0efc4a83b450a01b1166291c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.987648 13573 raft_consensus.cc:482] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:50.987797 13573 raft_consensus.cc:504] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:50.987671 13436 tablet_service.cc:1467] Processing CreateTablet for tablet e32b84c7de40447b8d01baa8385c7817 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20240503 14:12:50.988518 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b84c7de40447b8d01baa8385c7817. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.989128 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa59a1a71e92475eb287f0cdf7558884. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.990788 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 7d44249041c74ca48414ad2c6ca44ff8 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20240503 14:12:50.991174 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d44249041c74ca48414ad2c6ca44ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.991832 13573 leader_election.cc:288] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:50.992193 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:50.992547 13514 tablet_service.cc:1467] Processing CreateTablet for tablet fa59a1a71e92475eb287f0cdf7558884 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20240503 14:12:50.992615 13493 leader_election.cc:341] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:50.992909 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa59a1a71e92475eb287f0cdf7558884. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:50.992350 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:50.994865 13493 leader_election.cc:341] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:50.998713 13493 leader_election.cc:302] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:50.998996 13573 raft_consensus.cc:2726] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.040958 13366 tablet_service.cc:1467] Processing CreateTablet for tablet 03eaf58191a94b0ab4ef6ad226ca695a (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 14:12:51.041548 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03eaf58191a94b0ab4ef6ad226ca695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.044338 13367 tablet_service.cc:1467] Processing CreateTablet for tablet 66e224eae0d04ee1a8851dd89a88289b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 14:12:51.044943 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66e224eae0d04ee1a8851dd89a88289b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.045188 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 03eaf58191a94b0ab4ef6ad226ca695a (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 14:12:51.045614 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03eaf58191a94b0ab4ef6ad226ca695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.047842 13510 tablet_service.cc:1467] Processing CreateTablet for tablet 66e224eae0d04ee1a8851dd89a88289b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 14:12:51.048197 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66e224eae0d04ee1a8851dd89a88289b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.048399 13576 raft_consensus.cc:482] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.048513 13576 raft_consensus.cc:504] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.049461 13576 leader_election.cc:288] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.050889 13512 tablet_service.cc:1467] Processing CreateTablet for tablet eae4e983cf2042f7b03491e9dd3c38c9 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 14:12:51.051282 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae4e983cf2042f7b03491e9dd3c38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.051784 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 7b94535bb3734538b0c8850f2b24eaf5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 14:12:51.052148 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b94535bb3734538b0c8850f2b24eaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.057054 13360 tablet_service.cc:1467] Processing CreateTablet for tablet 7b94535bb3734538b0c8850f2b24eaf5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 14:12:51.057534 13360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b94535bb3734538b0c8850f2b24eaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.058486 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 14:12:51.058904 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.059958 13516 tablet_service.cc:1467] Processing CreateTablet for tablet 029feeb3cf3d4ff4a598be4b31293dec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 14:12:51.060339 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029feeb3cf3d4ff4a598be4b31293dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.066615 13517 tablet_service.cc:1467] Processing CreateTablet for tablet 39d5ee607c954f9393f1c1a6da677624 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 14:12:51.067116 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d5ee607c954f9393f1c1a6da677624. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.070219 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 14:12:51.072131 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.049366 13363 tablet_service.cc:1467] Processing CreateTablet for tablet eae4e983cf2042f7b03491e9dd3c38c9 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20240503 14:12:51.072782 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae4e983cf2042f7b03491e9dd3c38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.073632 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 03eaf58191a94b0ab4ef6ad226ca695a (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20240503 14:12:51.075137 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03eaf58191a94b0ab4ef6ad226ca695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.078784 13362 tablet_service.cc:1467] Processing CreateTablet for tablet 029feeb3cf3d4ff4a598be4b31293dec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 14:12:51.074729 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.084275 13570 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.084452 13570 ts_tablet_manager.cc:1367] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.188s user 0.037s sys 0.038s
I20240503 14:12:51.085321 13570 raft_consensus.cc:348] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.085569 13570 raft_consensus.cc:374] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.085619 13570 raft_consensus.cc:729] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.085870 13570 consensus_queue.cc:260] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.086488 13570 ts_tablet_manager.cc:1398] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.086838 13570 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
W20240503 14:12:51.088474 13343 leader_election.cc:341] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.089135 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029feeb3cf3d4ff4a598be4b31293dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.090682 13568 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.090855 13568 ts_tablet_manager.cc:1367] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.194s user 0.001s sys 0.003s
I20240503 14:12:51.098562 13569 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.098721 13569 ts_tablet_manager.cc:1367] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.138s user 0.006s sys 0.002s
I20240503 14:12:51.091586 13442 tablet_service.cc:1467] Processing CreateTablet for tablet 66e224eae0d04ee1a8851dd89a88289b (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20240503 14:12:51.103302 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66e224eae0d04ee1a8851dd89a88289b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.111032 13569 raft_consensus.cc:348] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.111426 13569 raft_consensus.cc:374] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.111546 13569 raft_consensus.cc:729] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.126446 13568 raft_consensus.cc:348] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.126818 13568 raft_consensus.cc:374] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.126910 13568 raft_consensus.cc:729] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.127195 13568 consensus_queue.cc:260] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.129705 13570 tablet_bootstrap.cc:654] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.136353 13569 consensus_queue.cc:260] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.136611 13573 raft_consensus.cc:482] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.139202 13515 tablet_service.cc:1467] Processing CreateTablet for tablet 3ded91c8b2d947d6968811a5c7f66fc5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 14:12:51.139727 13515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ded91c8b2d947d6968811a5c7f66fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.142570 13573 raft_consensus.cc:504] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.144475 13568 ts_tablet_manager.cc:1398] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.054s user 0.001s sys 0.002s
I20240503 14:12:51.144773 13568 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.146724 13364 tablet_service.cc:1467] Processing CreateTablet for tablet 39d5ee607c954f9393f1c1a6da677624 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 14:12:51.147167 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d5ee607c954f9393f1c1a6da677624. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.148313 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.148546 13435 tablet_service.cc:1467] Processing CreateTablet for tablet eae4e983cf2042f7b03491e9dd3c38c9 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20240503 14:12:51.148797 13344 leader_election.cc:341] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.148945 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae4e983cf2042f7b03491e9dd3c38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.148922 13344 leader_election.cc:302] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.149535 13575 raft_consensus.cc:2726] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.153048 13437 tablet_service.cc:1467] Processing CreateTablet for tablet 7b94535bb3734538b0c8850f2b24eaf5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20240503 14:12:51.156440 13573 leader_election.cc:288] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.157049 13437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b94535bb3734538b0c8850f2b24eaf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.157171 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.157169 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.157423 13379 raft_consensus.cc:2454] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.158373 13493 leader_election.cc:302] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.158603 13573 raft_consensus.cc:2781] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20240503 14:12:51.158612 13493 leader_election.cc:341] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.158704 13573 raft_consensus.cc:482] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.158805 13573 raft_consensus.cc:3037] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.161252 13513 tablet_service.cc:1467] Processing CreateTablet for tablet 6b820e9f27194e9d9304d7f36f965b13 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 14:12:51.162240 13513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b820e9f27194e9d9304d7f36f965b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.165556 13511 tablet_service.cc:1467] Processing CreateTablet for tablet edbd41f1f36442948cf2d14487f2fddf (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 14:12:51.167265 13511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edbd41f1f36442948cf2d14487f2fddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.175261 13568 tablet_bootstrap.cc:654] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.176633 13570 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.176803 13570 ts_tablet_manager.cc:1367] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.090s user 0.006s sys 0.005s
I20240503 14:12:51.178260 13444 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20240503 14:12:51.179553 13444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5c52e9e2cf45f79bb854b8ba51e00e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.185745 13368 tablet_service.cc:1467] Processing CreateTablet for tablet 3ded91c8b2d947d6968811a5c7f66fc5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 14:12:51.186223 13368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ded91c8b2d947d6968811a5c7f66fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.190380 13510 tablet_service.cc:1467] Processing CreateTablet for tablet e4e8c8e857544418b02526960eb52a66 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 14:12:51.191042 13510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4e8c8e857544418b02526960eb52a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.198387 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f96b0aa5024991b4ad009c8c1393ec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.198685 13379 raft_consensus.cc:2454] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.199584 13419 leader_election.cc:302] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.205353 13518 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb73037ea74c09a4a1cdf983284299 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 14:12:51.205935 13518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb73037ea74c09a4a1cdf983284299. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.210358 13576 raft_consensus.cc:2781] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.210497 13576 raft_consensus.cc:482] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.210572 13576 raft_consensus.cc:3037] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.210816 13569 ts_tablet_manager.cc:1398] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.112s user 0.025s sys 0.017s
I20240503 14:12:51.211124 13569 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.212877 13569 tablet_bootstrap.cc:654] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.213682 13576 raft_consensus.cc:504] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.218246 13570 raft_consensus.cc:348] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.218518 13570 raft_consensus.cc:374] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.218570 13570 raft_consensus.cc:729] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.221278 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f96b0aa5024991b4ad009c8c1393ec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.221506 13379 raft_consensus.cc:3037] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.221508 13568 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.221698 13568 ts_tablet_manager.cc:1367] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.077s user 0.006s sys 0.018s
I20240503 14:12:51.222304 13576 leader_election.cc:288] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.222333 13367 tablet_service.cc:1467] Processing CreateTablet for tablet edbd41f1f36442948cf2d14487f2fddf (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 14:12:51.222877 13367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edbd41f1f36442948cf2d14487f2fddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.227819 13570 consensus_queue.cc:260] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.228940 13570 ts_tablet_manager.cc:1398] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.052s user 0.003s sys 0.000s
I20240503 14:12:51.229208 13570 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.229686 13439 tablet_service.cc:1467] Processing CreateTablet for tablet 029feeb3cf3d4ff4a598be4b31293dec (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20240503 14:12:51.230159 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029feeb3cf3d4ff4a598be4b31293dec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.228818 13512 tablet_service.cc:1467] Processing CreateTablet for tablet 7438e76bfd9a47bf88d201f6caa059c4 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 14:12:51.232252 13512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7438e76bfd9a47bf88d201f6caa059c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.233188 13514 tablet_service.cc:1467] Processing CreateTablet for tablet 77cf310d80ce4590af30673b67e30d38 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 14:12:51.236253 13514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77cf310d80ce4590af30673b67e30d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.240705 13366 tablet_service.cc:1467] Processing CreateTablet for tablet 6b820e9f27194e9d9304d7f36f965b13 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 14:12:51.241154 13366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b820e9f27194e9d9304d7f36f965b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.244050 13365 tablet_service.cc:1467] Processing CreateTablet for tablet e4e8c8e857544418b02526960eb52a66 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 14:12:51.244575 13365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4e8c8e857544418b02526960eb52a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.247000 13369 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb73037ea74c09a4a1cdf983284299 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 14:12:51.250030 13364 tablet_service.cc:1467] Processing CreateTablet for tablet 7438e76bfd9a47bf88d201f6caa059c4 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 14:12:51.250496 13364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7438e76bfd9a47bf88d201f6caa059c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.251014 13361 tablet_service.cc:1467] Processing CreateTablet for tablet 77cf310d80ce4590af30673b67e30d38 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 14:12:51.251353 13361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77cf310d80ce4590af30673b67e30d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.251756 13443 tablet_service.cc:1467] Processing CreateTablet for tablet 3ded91c8b2d947d6968811a5c7f66fc5 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20240503 14:12:51.252470 13517 tablet_service.cc:1467] Processing CreateTablet for tablet a5c8bbae71c641998f6f6171ad848075 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 14:12:51.252873 13517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c8bbae71c641998f6f6171ad848075. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.254312 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f96b0aa5024991b4ad009c8c1393ec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.254307 13509 tablet_service.cc:1467] Processing CreateTablet for tablet a21bd6acda964ddf87d770e3fdbe3789 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 14:12:51.255455 13509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21bd6acda964ddf87d770e3fdbe3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.255412 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97f96b0aa5024991b4ad009c8c1393ec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
W20240503 14:12:51.256121 13418 leader_election.cc:341] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:51.256579 13418 leader_election.cc:341] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.257212 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ded91c8b2d947d6968811a5c7f66fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.256778 13438 tablet_service.cc:1467] Processing CreateTablet for tablet 39d5ee607c954f9393f1c1a6da677624 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20240503 14:12:51.258374 13369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb73037ea74c09a4a1cdf983284299. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.260289 13568 raft_consensus.cc:348] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.260494 13568 raft_consensus.cc:374] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.260543 13568 raft_consensus.cc:729] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.263175 13568 consensus_queue.cc:260] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.264086 13438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39d5ee607c954f9393f1c1a6da677624. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.266016 13568 ts_tablet_manager.cc:1398] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20240503 14:12:51.266482 13568 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.271389 13442 tablet_service.cc:1467] Processing CreateTablet for tablet edbd41f1f36442948cf2d14487f2fddf (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20240503 14:12:51.271792 13442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edbd41f1f36442948cf2d14487f2fddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.270503 13436 tablet_service.cc:1467] Processing CreateTablet for tablet 6b820e9f27194e9d9304d7f36f965b13 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20240503 14:12:51.274626 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b820e9f27194e9d9304d7f36f965b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.272969 13516 tablet_service.cc:1467] Processing CreateTablet for tablet 2c9795c8fe964648b5a8be26c32f6499 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 14:12:51.279345 13516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c9795c8fe964648b5a8be26c32f6499. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.280220 13360 tablet_service.cc:1467] Processing CreateTablet for tablet a21bd6acda964ddf87d770e3fdbe3789 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 14:12:51.280609 13360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21bd6acda964ddf87d770e3fdbe3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.281828 13568 tablet_bootstrap.cc:654] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.284237 13573 raft_consensus.cc:504] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.284332 13440 tablet_service.cc:1467] Processing CreateTablet for tablet e4e8c8e857544418b02526960eb52a66 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20240503 14:12:51.284852 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4e8c8e857544418b02526960eb52a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.284897 13573 leader_election.cc:288] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.286933 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
W20240503 14:12:51.287420 13493 leader_election.cc:341] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:51.275223 13325 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 14:12:51.289553 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ca7f69e4b2f4cf3a9c5e262606c8960" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.291222 13378 raft_consensus.cc:3037] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.301002 13568 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.301242 13568 ts_tablet_manager.cc:1367] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.000s
I20240503 14:12:51.305400 13576 raft_consensus.cc:482] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.305521 13570 tablet_bootstrap.cc:654] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.305622 13576 raft_consensus.cc:504] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.308068 13576 leader_election.cc:288] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.308600 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:51.309155 13418 leader_election.cc:341] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.307113 13362 tablet_service.cc:1467] Processing CreateTablet for tablet a5c8bbae71c641998f6f6171ad848075 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 14:12:51.309967 13362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c8bbae71c641998f6f6171ad848075. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.306921 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:51.310801 13419 leader_election.cc:341] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.310914 13419 leader_election.cc:302] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.312283 13576 raft_consensus.cc:2726] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.314643 13569 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.314814 13569 ts_tablet_manager.cc:1367] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.104s user 0.032s sys 0.044s
I20240503 14:12:51.321311 13363 tablet_service.cc:1467] Processing CreateTablet for tablet 2c9795c8fe964648b5a8be26c32f6499 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 14:12:51.322116 13363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c9795c8fe964648b5a8be26c32f6499. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.326891 13437 tablet_service.cc:1467] Processing CreateTablet for tablet 6bdb73037ea74c09a4a1cdf983284299 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20240503 14:12:51.327457 13437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb73037ea74c09a4a1cdf983284299. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.329429 13568 raft_consensus.cc:348] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.329677 13568 raft_consensus.cc:374] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.329742 13568 raft_consensus.cc:729] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.330039 13568 consensus_queue.cc:260] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.337317 13568 ts_tablet_manager.cc:1398] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.036s user 0.003s sys 0.000s
I20240503 14:12:51.337779 13568 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.338438 13569 raft_consensus.cc:348] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.338665 13569 raft_consensus.cc:374] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.338721 13569 raft_consensus.cc:729] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.338758 13379 raft_consensus.cc:2454] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.338948 13569 consensus_queue.cc:260] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.339322 13419 leader_election.cc:302] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters: 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.339743 13576 raft_consensus.cc:2781] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.340108 13440 tablet_service.cc:1467] Processing CreateTablet for tablet 7438e76bfd9a47bf88d201f6caa059c4 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20240503 14:12:51.340461 13569 ts_tablet_manager.cc:1398] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.026s user 0.001s sys 0.001s
I20240503 14:12:51.340595 13440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7438e76bfd9a47bf88d201f6caa059c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.340793 13569 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.347846 13435 tablet_service.cc:1467] Processing CreateTablet for tablet 77cf310d80ce4590af30673b67e30d38 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20240503 14:12:51.348322 13435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77cf310d80ce4590af30673b67e30d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.350656 13378 raft_consensus.cc:2454] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.351329 13493 leader_election.cc:302] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8
I20240503 14:12:51.351712 13573 raft_consensus.cc:2781] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.351876 13573 raft_consensus.cc:686] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:51.352141 13573 consensus_queue.cc:237] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.352597 13570 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.353751 13570 ts_tablet_manager.cc:1367] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.125s user 0.011s sys 0.004s
I20240503 14:12:51.358549 13568 tablet_bootstrap.cc:654] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.376277 13570 raft_consensus.cc:348] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.376713 13570 raft_consensus.cc:374] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.376829 13570 raft_consensus.cc:729] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.377182 13570 consensus_queue.cc:260] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.385447 13576 raft_consensus.cc:686] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.386288 13576 consensus_queue.cc:237] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.387631 13436 tablet_service.cc:1467] Processing CreateTablet for tablet a5c8bbae71c641998f6f6171ad848075 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20240503 14:12:51.388199 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c8bbae71c641998f6f6171ad848075. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.389626 13570 ts_tablet_manager.cc:1398] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.036s user 0.003s sys 0.006s
I20240503 14:12:51.389961 13570 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.392187 13570 tablet_bootstrap.cc:654] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.381384 13443 tablet_service.cc:1467] Processing CreateTablet for tablet a21bd6acda964ddf87d770e3fdbe3789 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20240503 14:12:51.398473 13443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21bd6acda964ddf87d770e3fdbe3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.409603 13276 catalog_manager.cc:5484] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.409934 13436 tablet_service.cc:1467] Processing CreateTablet for tablet 2c9795c8fe964648b5a8be26c32f6499 (DEFAULT_TABLE table=test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20240503 14:12:51.410401 13569 tablet_bootstrap.cc:654] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.410660 13436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c9795c8fe964648b5a8be26c32f6499. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:51.434931 13275 catalog_manager.cc:5484] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.453301 13569 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.453478 13569 ts_tablet_manager.cc:1367] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.113s user 0.010s sys 0.002s
I20240503 14:12:51.454622 13570 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.455857 13570 ts_tablet_manager.cc:1367] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.066s user 0.011s sys 0.044s
I20240503 14:12:51.454977 13569 raft_consensus.cc:348] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.456095 13569 raft_consensus.cc:374] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.456185 13569 raft_consensus.cc:729] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.456475 13569 consensus_queue.cc:260] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.456566 13570 raft_consensus.cc:348] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.456719 13570 raft_consensus.cc:374] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.456771 13570 raft_consensus.cc:729] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.456959 13570 consensus_queue.cc:260] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.457023 13569 ts_tablet_manager.cc:1398] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:51.457437 13569 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.457468 13570 ts_tablet_manager.cc:1398] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.457684 13570 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.459442 13570 tablet_bootstrap.cc:654] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.459445 13569 tablet_bootstrap.cc:654] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.461575 13568 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.461757 13568 ts_tablet_manager.cc:1367] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.124s user 0.006s sys 0.000s
I20240503 14:12:51.462741 13568 raft_consensus.cc:348] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.463014 13568 raft_consensus.cc:374] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.463073 13568 raft_consensus.cc:729] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.463454 13568 consensus_queue.cc:260] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.466848 13569 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.467016 13569 ts_tablet_manager.cc:1367] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240503 14:12:51.467741 13569 raft_consensus.cc:348] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.467941 13569 raft_consensus.cc:374] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.468021 13569 raft_consensus.cc:729] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.468240 13569 consensus_queue.cc:260] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.468704 13569 ts_tablet_manager.cc:1398] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.468926 13569 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.466877 13568 ts_tablet_manager.cc:1398] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240503 14:12:51.470324 13568 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.470593 13569 tablet_bootstrap.cc:654] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.471774 13568 tablet_bootstrap.cc:654] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.473306 13570 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.473455 13570 ts_tablet_manager.cc:1367] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20240503 14:12:51.474081 13570 raft_consensus.cc:348] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.474283 13570 raft_consensus.cc:374] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.474339 13570 raft_consensus.cc:729] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.474560 13570 consensus_queue.cc:260] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.475135 13570 ts_tablet_manager.cc:1398] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:51.475409 13570 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.476351 13569 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.476509 13569 ts_tablet_manager.cc:1367] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20240503 14:12:51.477125 13570 tablet_bootstrap.cc:654] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.477234 13569 raft_consensus.cc:348] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.477445 13569 raft_consensus.cc:374] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.477504 13569 raft_consensus.cc:729] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.477727 13569 consensus_queue.cc:260] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.479029 13568 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.479245 13568 ts_tablet_manager.cc:1367] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s
I20240503 14:12:51.479650 13569 ts_tablet_manager.cc:1398] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:51.479951 13569 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.480202 13568 raft_consensus.cc:348] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.480499 13568 raft_consensus.cc:374] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.480641 13568 raft_consensus.cc:729] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.481002 13568 consensus_queue.cc:260] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.481717 13569 tablet_bootstrap.cc:654] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.483701 13568 ts_tablet_manager.cc:1398] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:51.484360 13570 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.484508 13570 ts_tablet_manager.cc:1367] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20240503 14:12:51.485276 13570 raft_consensus.cc:348] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.485495 13570 raft_consensus.cc:374] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.485559 13570 raft_consensus.cc:729] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.485774 13570 consensus_queue.cc:260] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.486279 13570 ts_tablet_manager.cc:1398] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.486459 13568 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.486622 13570 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.488338 13569 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.488363 13568 tablet_bootstrap.cc:654] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.488471 13569 ts_tablet_manager.cc:1367] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.008s
I20240503 14:12:51.489007 13569 raft_consensus.cc:348] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.489156 13569 raft_consensus.cc:374] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.489187 13569 raft_consensus.cc:729] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.489404 13569 consensus_queue.cc:260] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.490505 13568 tablet_bootstrap.cc:492] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.490550 13570 tablet_bootstrap.cc:654] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.490639 13568 ts_tablet_manager.cc:1367] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240503 14:12:51.491412 13568 raft_consensus.cc:348] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.491621 13568 raft_consensus.cc:374] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.491681 13568 raft_consensus.cc:729] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.491899 13568 consensus_queue.cc:260] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.492430 13568 ts_tablet_manager.cc:1398] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.492448 13569 ts_tablet_manager.cc:1398] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 14:12:51.492765 13569 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.494556 13569 tablet_bootstrap.cc:654] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.494632 13568 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.496994 13568 tablet_bootstrap.cc:654] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.498847 13570 tablet_bootstrap.cc:492] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.499025 13570 ts_tablet_manager.cc:1367] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20240503 14:12:51.499850 13570 raft_consensus.cc:348] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.500075 13570 raft_consensus.cc:374] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.500124 13570 raft_consensus.cc:729] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.500394 13570 consensus_queue.cc:260] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.503762 13570 ts_tablet_manager.cc:1398] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20240503 14:12:51.503875 13568 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.504047 13568 ts_tablet_manager.cc:1367] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.004s
I20240503 14:12:51.504135 13570 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.504817 13568 raft_consensus.cc:348] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.504997 13568 raft_consensus.cc:374] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.505043 13568 raft_consensus.cc:729] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.505239 13568 consensus_queue.cc:260] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.505776 13568 ts_tablet_manager.cc:1398] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.506736 13569 tablet_bootstrap.cc:492] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.506807 13568 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.506871 13569 ts_tablet_manager.cc:1367] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.003s
I20240503 14:12:51.507208 13570 tablet_bootstrap.cc:654] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.507580 13569 raft_consensus.cc:348] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.507800 13569 raft_consensus.cc:374] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.507854 13569 raft_consensus.cc:729] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.508132 13569 consensus_queue.cc:260] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.508607 13568 tablet_bootstrap.cc:654] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.509577 13569 ts_tablet_manager.cc:1398] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:51.509918 13569 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.511936 13569 tablet_bootstrap.cc:654] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.515506 13570 tablet_bootstrap.cc:492] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.515677 13570 ts_tablet_manager.cc:1367] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s
I20240503 14:12:51.516314 13570 raft_consensus.cc:348] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.516494 13570 raft_consensus.cc:374] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.516543 13570 raft_consensus.cc:729] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.516762 13570 consensus_queue.cc:260] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } }
I20240503 14:12:51.517380 13570 ts_tablet_manager.cc:1398] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.517679 13570 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.521281 13570 tablet_bootstrap.cc:654] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.521908 13568 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.522130 13568 ts_tablet_manager.cc:1367] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.013s
I20240503 14:12:51.522931 13568 raft_consensus.cc:348] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.523119 13568 raft_consensus.cc:374] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.523186 13568 raft_consensus.cc:729] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.523429 13568 consensus_queue.cc:260] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.523663 13569 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.523802 13569 ts_tablet_manager.cc:1367] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.002s
I20240503 14:12:51.523839 13570 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.523960 13570 ts_tablet_manager.cc:1367] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20240503 14:12:51.524772 13568 ts_tablet_manager.cc:1398] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:51.524653 13570 raft_consensus.cc:348] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.524642 13569 raft_consensus.cc:348] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.524854 13570 raft_consensus.cc:374] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.524900 13569 raft_consensus.cc:374] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.524905 13570 raft_consensus.cc:729] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.524966 13569 raft_consensus.cc:729] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.525115 13568 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.525146 13570 consensus_queue.cc:260] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.525331 13569 consensus_queue.cc:260] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.526444 13570 ts_tablet_manager.cc:1398] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.526615 13569 ts_tablet_manager.cc:1398] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:51.526701 13575 raft_consensus.cc:482] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.526880 13569 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.526815 13575 raft_consensus.cc:504] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.526975 13568 tablet_bootstrap.cc:654] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.527498 13575 leader_election.cc:288] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.528115 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbff04261a5a4f37a39b9e0a8dada8aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.528298 13454 raft_consensus.cc:2454] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.528741 13569 tablet_bootstrap.cc:654] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.528802 13595 raft_consensus.cc:482] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.528913 13595 raft_consensus.cc:504] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.529659 13595 leader_election.cc:288] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.530033 13344 leader_election.cc:302] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.530572 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbff04261a5a4f37a39b9e0a8dada8aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.530763 13528 raft_consensus.cc:2454] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.531172 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:51.532053 13419 leader_election.cc:341] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.532404 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.532582 13528 raft_consensus.cc:2454] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.532944 13418 leader_election.cc:302] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.533512 13575 raft_consensus.cc:2781] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.533586 13575 raft_consensus.cc:482] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.533641 13575 raft_consensus.cc:3037] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.534070 13595 raft_consensus.cc:2781] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.534137 13595 raft_consensus.cc:482] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.534197 13595 raft_consensus.cc:3037] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.534407 13573 raft_consensus.cc:482] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.534571 13573 raft_consensus.cc:504] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.535409 13573 leader_election.cc:288] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.536136 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2156b9064a4e6d972b5a10af68bada" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.536176 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2156b9064a4e6d972b5a10af68bada" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.536375 13378 raft_consensus.cc:2454] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.536384 13454 raft_consensus.cc:2454] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.536834 13493 leader_election.cc:302] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.537005 13595 raft_consensus.cc:504] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.537134 13569 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.537268 13569 ts_tablet_manager.cc:1367] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20240503 14:12:51.537334 13573 raft_consensus.cc:2781] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.537412 13573 raft_consensus.cc:482] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.537487 13573 raft_consensus.cc:3037] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.538015 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.538161 13569 raft_consensus.cc:348] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.538342 13569 raft_consensus.cc:374] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.538398 13569 raft_consensus.cc:729] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.538620 13569 consensus_queue.cc:260] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.539353 13569 ts_tablet_manager.cc:1398] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.540117 13569 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.540925 13575 raft_consensus.cc:504] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:51.541776 13419 leader_election.cc:341] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.541872 13569 tablet_bootstrap.cc:654] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.541929 13568 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.542069 13568 ts_tablet_manager.cc:1367] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.000s
I20240503 14:12:51.542254 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbff04261a5a4f37a39b9e0a8dada8aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.542456 13454 raft_consensus.cc:3037] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.542929 13568 raft_consensus.cc:348] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.543115 13568 raft_consensus.cc:374] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.543167 13568 raft_consensus.cc:729] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.543449 13568 consensus_queue.cc:260] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.545137 13454 raft_consensus.cc:2454] T cbff04261a5a4f37a39b9e0a8dada8aa P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.545534 13344 leader_election.cc:302] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.546232 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.546406 13528 raft_consensus.cc:3037] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.547286 13621 raft_consensus.cc:2781] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.548020 13568 ts_tablet_manager.cc:1398] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20240503 14:12:51.548360 13568 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.549345 13528 raft_consensus.cc:2454] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.549780 13418 leader_election.cc:302] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.550112 13576 raft_consensus.cc:2781] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.550237 13576 raft_consensus.cc:686] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.550334 13568 tablet_bootstrap.cc:654] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.550508 13576 consensus_queue.cc:237] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.545534 13595 leader_election.cc:288] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.540925 13573 raft_consensus.cc:504] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.552796 13573 leader_election.cc:288] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.553320 13621 raft_consensus.cc:686] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.553486 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2156b9064a4e6d972b5a10af68bada" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.553686 13378 raft_consensus.cc:3037] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.553725 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d2156b9064a4e6d972b5a10af68bada" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.554011 13454 raft_consensus.cc:3037] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.553695 13621 consensus_queue.cc:237] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.555737 13569 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.555954 13569 ts_tablet_manager.cc:1367] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.005s
I20240503 14:12:51.556932 13378 raft_consensus.cc:2454] T 8d2156b9064a4e6d972b5a10af68bada P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.556824 13569 raft_consensus.cc:348] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.557075 13569 raft_consensus.cc:374] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.557139 13569 raft_consensus.cc:729] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.557173 13454 raft_consensus.cc:2454] T 8d2156b9064a4e6d972b5a10af68bada P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.557420 13493 leader_election.cc:302] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.557391 13569 consensus_queue.cc:260] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.553488 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbff04261a5a4f37a39b9e0a8dada8aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.557868 13528 raft_consensus.cc:3037] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.558019 13588 raft_consensus.cc:2781] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.558135 13588 raft_consensus.cc:686] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:51.558475 13588 consensus_queue.cc:237] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.559494 13575 leader_election.cc:288] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.562126 13569 ts_tablet_manager.cc:1398] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240503 14:12:51.562474 13569 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.562497 13570 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.563905 13528 raft_consensus.cc:2454] T cbff04261a5a4f37a39b9e0a8dada8aa P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.564406 13569 tablet_bootstrap.cc:654] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.564579 13570 tablet_bootstrap.cc:654] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.567970 13274 catalog_manager.cc:5484] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.572993 13569 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.573179 13569 ts_tablet_manager.cc:1367] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.003s
I20240503 14:12:51.573571 13568 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.573714 13568 ts_tablet_manager.cc:1367] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20240503 14:12:51.573962 13569 raft_consensus.cc:348] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.574194 13569 raft_consensus.cc:374] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.574265 13569 raft_consensus.cc:729] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.574441 13568 raft_consensus.cc:348] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.574615 13568 raft_consensus.cc:374] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.574669 13568 raft_consensus.cc:729] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.574579 13569 consensus_queue.cc:260] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.574889 13568 consensus_queue.cc:260] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.575103 13569 ts_tablet_manager.cc:1398] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:51.575364 13568 ts_tablet_manager.cc:1398] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.575376 13569 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.575606 13568 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.576609 13274 catalog_manager.cc:5484] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:51.577280 13569 tablet_bootstrap.cc:654] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.578761 13595 raft_consensus.cc:482] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.578893 13595 raft_consensus.cc:504] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.579061 13568 tablet_bootstrap.cc:654] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.579270 13575 raft_consensus.cc:482] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.579373 13575 raft_consensus.cc:504] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.580274 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb2aad6a2524734ad7fb9067db7372c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.580497 13454 raft_consensus.cc:2454] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.580941 13344 leader_election.cc:302] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.582029 13275 catalog_manager.cc:5484] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.583010 13568 tablet_bootstrap.cc:492] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.583190 13568 ts_tablet_manager.cc:1367] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20240503 14:12:51.584019 13568 raft_consensus.cc:348] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.584760 13568 raft_consensus.cc:374] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.584766 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:51.585505 13418 leader_election.cc:341] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.585718 13595 leader_election.cc:288] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.584933 13575 leader_election.cc:288] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.585896 13575 raft_consensus.cc:2781] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.585965 13575 raft_consensus.cc:482] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.586052 13575 raft_consensus.cc:3037] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.589376 13575 raft_consensus.cc:504] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.590104 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:51.590655 13419 leader_election.cc:341] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.590747 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb2aad6a2524734ad7fb9067db7372c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.590821 13419 leader_election.cc:302] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.590945 13454 raft_consensus.cc:3037] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.591451 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb2aad6a2524734ad7fb9067db7372c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.591683 13528 raft_consensus.cc:2454] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.592482 13576 raft_consensus.cc:2726] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.594287 13454 raft_consensus.cc:2454] T ddb2aad6a2524734ad7fb9067db7372c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.594806 13344 leader_election.cc:302] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.595155 13621 raft_consensus.cc:2781] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.595732 13621 raft_consensus.cc:686] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.595803 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ddb2aad6a2524734ad7fb9067db7372c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.596011 13528 raft_consensus.cc:3037] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.596079 13621 consensus_queue.cc:237] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.599438 13528 raft_consensus.cc:2454] T ddb2aad6a2524734ad7fb9067db7372c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.600147 13575 leader_election.cc:288] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.585052 13568 raft_consensus.cc:729] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.600807 13568 consensus_queue.cc:260] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.601513 13568 ts_tablet_manager.cc:1398] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.018s user 0.000s sys 0.002s
I20240503 14:12:51.601888 13568 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.605553 13568 tablet_bootstrap.cc:654] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.605957 13570 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.606249 13570 ts_tablet_manager.cc:1367] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.044s user 0.017s sys 0.017s
I20240503 14:12:51.606266 13569 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.606555 13569 ts_tablet_manager.cc:1367] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.031s user 0.021s sys 0.006s
I20240503 14:12:51.607525 13570 raft_consensus.cc:348] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.607571 13569 raft_consensus.cc:348] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.607909 13569 raft_consensus.cc:374] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.607983 13569 raft_consensus.cc:729] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.607851 13570 raft_consensus.cc:374] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.608136 13570 raft_consensus.cc:729] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.608299 13569 consensus_queue.cc:260] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.608454 13570 consensus_queue.cc:260] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.611574 13570 ts_tablet_manager.cc:1398] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 14:12:51.612089 13570 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.612758 13569 ts_tablet_manager.cc:1398] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 14:12:51.616628 13569 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.619274 13569 tablet_bootstrap.cc:654] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.619061 13274 catalog_manager.cc:5484] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.619510 13588 raft_consensus.cc:482] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.619643 13588 raft_consensus.cc:504] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.620486 13588 leader_election.cc:288] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.619288 13570 tablet_bootstrap.cc:654] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.622346 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:51.622946 13493 leader_election.cc:341] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.623602 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:51.624049 13493 leader_election.cc:341] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.624567 13493 leader_election.cc:302] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.624840 13588 raft_consensus.cc:2726] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.631773 13570 tablet_bootstrap.cc:492] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.632072 13570 ts_tablet_manager.cc:1367] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.009s
I20240503 14:12:51.631773 13568 tablet_bootstrap.cc:492] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.632476 13568 ts_tablet_manager.cc:1367] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.013s
I20240503 14:12:51.633013 13569 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.632993 13570 raft_consensus.cc:348] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.633170 13569 ts_tablet_manager.cc:1367] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.012s
I20240503 14:12:51.633167 13568 raft_consensus.cc:348] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.633328 13568 raft_consensus.cc:374] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.633379 13568 raft_consensus.cc:729] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.633620 13568 consensus_queue.cc:260] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.633886 13569 raft_consensus.cc:348] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.634086 13569 raft_consensus.cc:374] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.634141 13569 raft_consensus.cc:729] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.634305 13568 ts_tablet_manager.cc:1398] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.634318 13569 consensus_queue.cc:260] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.634662 13568 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.634905 13569 ts_tablet_manager.cc:1398] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:51.635141 13569 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.636314 13568 tablet_bootstrap.cc:654] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.636752 13569 tablet_bootstrap.cc:654] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.641853 13569 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.642047 13569 ts_tablet_manager.cc:1367] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240503 14:12:51.642916 13569 raft_consensus.cc:348] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.643143 13569 raft_consensus.cc:374] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.643200 13569 raft_consensus.cc:729] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.643450 13569 consensus_queue.cc:260] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.644083 13569 ts_tablet_manager.cc:1398] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.644376 13569 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.646878 13569 tablet_bootstrap.cc:654] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.648784 13570 raft_consensus.cc:374] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.648830 13568 tablet_bootstrap.cc:492] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.648900 13570 raft_consensus.cc:729] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.649026 13568 ts_tablet_manager.cc:1367] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.004s
I20240503 14:12:51.649120 13570 consensus_queue.cc:260] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.649789 13568 raft_consensus.cc:348] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.650008 13568 raft_consensus.cc:374] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.650072 13568 raft_consensus.cc:729] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.650257 13568 consensus_queue.cc:260] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.650689 13570 ts_tablet_manager.cc:1398] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.019s user 0.016s sys 0.000s
I20240503 14:12:51.650815 13568 ts_tablet_manager.cc:1398] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.650995 13570 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.651053 13568 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.651659 13569 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.651794 13569 ts_tablet_manager.cc:1367] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s
I20240503 14:12:51.652456 13570 tablet_bootstrap.cc:654] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.652484 13569 raft_consensus.cc:348] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.652690 13569 raft_consensus.cc:374] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.652745 13569 raft_consensus.cc:729] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.652842 13568 tablet_bootstrap.cc:654] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.652980 13569 consensus_queue.cc:260] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.653661 13569 ts_tablet_manager.cc:1398] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.654000 13569 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.655457 13569 tablet_bootstrap.cc:654] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.663573 13569 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.663764 13569 ts_tablet_manager.cc:1367] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20240503 14:12:51.664614 13569 raft_consensus.cc:348] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.664827 13569 raft_consensus.cc:374] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.664887 13569 raft_consensus.cc:729] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.665134 13588 raft_consensus.cc:482] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.665251 13588 raft_consensus.cc:504] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.665881 13588 leader_election.cc:288] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.666616 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.666796 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.666828 13569 consensus_queue.cc:260] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.667091 13570 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
W20240503 14:12:51.667156 13493 leader_election.cc:341] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.667229 13570 ts_tablet_manager.cc:1367] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.010s
W20240503 14:12:51.667366 13493 leader_election.cc:341] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.667464 13493 leader_election.cc:302] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.667595 13569 ts_tablet_manager.cc:1398] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:12:51.667855 13569 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.667865 13570 raft_consensus.cc:348] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.668077 13570 raft_consensus.cc:374] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.668130 13570 raft_consensus.cc:729] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.668332 13570 consensus_queue.cc:260] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.668859 13570 ts_tablet_manager.cc:1398] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.669113 13570 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.669546 13569 tablet_bootstrap.cc:654] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.670243 13588 raft_consensus.cc:2726] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.670315 13570 tablet_bootstrap.cc:654] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.671581 13568 tablet_bootstrap.cc:492] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.671797 13568 ts_tablet_manager.cc:1367] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.007s
I20240503 14:12:51.672585 13568 raft_consensus.cc:348] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.672899 13568 raft_consensus.cc:374] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.672999 13568 raft_consensus.cc:729] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.673282 13568 consensus_queue.cc:260] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.674068 13568 ts_tablet_manager.cc:1398] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.674438 13568 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.676412 13568 tablet_bootstrap.cc:654] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.677218 13621 raft_consensus.cc:482] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.677579 13621 raft_consensus.cc:504] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.678294 13621 leader_election.cc:288] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.678642 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11392c75b3284fa892b06d7e83b09aa2" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.678853 13454 raft_consensus.cc:2454] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.678977 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11392c75b3284fa892b06d7e83b09aa2" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.679211 13528 raft_consensus.cc:2454] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.679286 13344 leader_election.cc:302] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.679558 13621 raft_consensus.cc:2781] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.679639 13621 raft_consensus.cc:482] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.679706 13621 raft_consensus.cc:3037] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.680819 13569 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.680965 13569 ts_tablet_manager.cc:1367] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.004s
I20240503 14:12:51.681700 13569 raft_consensus.cc:348] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.681890 13569 raft_consensus.cc:374] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.681941 13569 raft_consensus.cc:729] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.682202 13569 consensus_queue.cc:260] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.682770 13569 ts_tablet_manager.cc:1398] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.682823 13621 raft_consensus.cc:504] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.683142 13569 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.683912 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11392c75b3284fa892b06d7e83b09aa2" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.684113 13454 raft_consensus.cc:3037] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.684904 13569 tablet_bootstrap.cc:654] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.687163 13454 raft_consensus.cc:2454] T 11392c75b3284fa892b06d7e83b09aa2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.687635 13344 leader_election.cc:302] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.687939 13575 raft_consensus.cc:2781] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.688081 13575 raft_consensus.cc:686] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.688378 13575 consensus_queue.cc:237] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.688979 13569 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.689118 13569 ts_tablet_manager.cc:1367] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240503 14:12:51.689729 13569 raft_consensus.cc:348] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.689918 13569 raft_consensus.cc:374] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.690006 13569 raft_consensus.cc:729] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.690259 13569 consensus_queue.cc:260] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.690902 13569 ts_tablet_manager.cc:1398] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.691104 13576 raft_consensus.cc:482] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.691232 13576 raft_consensus.cc:504] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.691308 13588 raft_consensus.cc:482] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.691452 13588 raft_consensus.cc:504] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.691893 13576 leader_election.cc:288] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.691982 13588 leader_election.cc:288] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.692250 13575 raft_consensus.cc:482] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.692363 13575 raft_consensus.cc:504] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.692687 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.692534 13275 catalog_manager.cc:5484] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.692921 13575 leader_election.cc:288] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
W20240503 14:12:51.693302 13493 leader_election.cc:341] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.693537 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.693575 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:51.693922 13493 leader_election.cc:341] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.694046 13493 leader_election.cc:302] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.694240 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.694343 13621 leader_election.cc:288] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.694391 13528 raft_consensus.cc:2454] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.694487 13569 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.694976 13570 tablet_bootstrap.cc:492] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.695113 13570 ts_tablet_manager.cc:1367] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.004s
I20240503 14:12:51.695809 13570 raft_consensus.cc:348] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.695955 13569 tablet_bootstrap.cc:654] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.696024 13570 raft_consensus.cc:374] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.696076 13570 raft_consensus.cc:729] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.696334 13570 consensus_queue.cc:260] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.697360 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.697656 13418 leader_election.cc:302] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.698050 13576 raft_consensus.cc:2781] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.698140 13576 raft_consensus.cc:482] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.698204 13576 raft_consensus.cc:3037] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.698295 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11392c75b3284fa892b06d7e83b09aa2" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.698441 13527 raft_consensus.cc:3037] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.699224 13568 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.699373 13568 ts_tablet_manager.cc:1367] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.011s
I20240503 14:12:51.700126 13568 raft_consensus.cc:348] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.700317 13568 raft_consensus.cc:374] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.700361 13568 raft_consensus.cc:729] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.700563 13568 consensus_queue.cc:260] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.700942 13527 raft_consensus.cc:2454] T 11392c75b3284fa892b06d7e83b09aa2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.701207 13568 ts_tablet_manager.cc:1398] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.701517 13568 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.702123 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49bed4cea1814a33870695d2a9c8ba9b" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.702368 13528 raft_consensus.cc:2379] T 49bed4cea1814a33870695d2a9c8ba9b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:51.698062 13570 ts_tablet_manager.cc:1398] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20240503 14:12:51.702807 13419 leader_election.cc:341] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.703014 13570 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.703346 13568 tablet_bootstrap.cc:654] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.704041 13343 leader_election.cc:302] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.704382 13570 tablet_bootstrap.cc:654] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.704432 13621 raft_consensus.cc:3037] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.707108 13621 raft_consensus.cc:2726] T 49bed4cea1814a33870695d2a9c8ba9b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.694404 13588 raft_consensus.cc:2726] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.700954 13576 raft_consensus.cc:504] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.711542 13568 tablet_bootstrap.cc:492] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.711719 13568 ts_tablet_manager.cc:1367] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20240503 14:12:51.711778 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:51.712644 13419 leader_election.cc:341] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.712738 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.712925 13528 raft_consensus.cc:3037] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.713248 13568 raft_consensus.cc:348] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.713443 13568 raft_consensus.cc:374] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.713505 13568 raft_consensus.cc:729] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.713765 13568 consensus_queue.cc:260] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.715730 13568 ts_tablet_manager.cc:1398] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:12:51.716123 13568 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.716315 13528 raft_consensus.cc:2454] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.716899 13418 leader_election.cc:302] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.717216 13595 raft_consensus.cc:2781] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.717326 13595 raft_consensus.cc:686] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.717617 13595 consensus_queue.cc:237] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.718648 13568 tablet_bootstrap.cc:654] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.719470 13570 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.719607 13570 ts_tablet_manager.cc:1367] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20240503 14:12:51.720455 13570 raft_consensus.cc:348] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.720687 13570 raft_consensus.cc:374] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.720790 13570 raft_consensus.cc:729] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.721057 13570 consensus_queue.cc:260] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.721766 13570 ts_tablet_manager.cc:1398] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20240503 14:12:51.722155 13570 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.722725 13576 leader_election.cc:288] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.725643 13570 tablet_bootstrap.cc:654] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.729302 13570 tablet_bootstrap.cc:492] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.729544 13570 ts_tablet_manager.cc:1367] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240503 14:12:51.730489 13570 raft_consensus.cc:348] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.730756 13570 raft_consensus.cc:374] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.730849 13570 raft_consensus.cc:729] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.731179 13570 consensus_queue.cc:260] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.731915 13570 ts_tablet_manager.cc:1398] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:51.732309 13570 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.734760 13570 tablet_bootstrap.cc:654] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.735934 13274 catalog_manager.cc:5484] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.738890 13621 raft_consensus.cc:482] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.739097 13621 raft_consensus.cc:504] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.739910 13621 leader_election.cc:288] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.741156 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb256c58a6714ec0be5fb71b9ffb121d" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.741430 13454 raft_consensus.cc:2454] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.742010 13344 leader_election.cc:302] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.742347 13621 raft_consensus.cc:2781] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.742460 13621 raft_consensus.cc:482] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.742544 13621 raft_consensus.cc:3037] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.752818 13621 raft_consensus.cc:504] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.754858 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb256c58a6714ec0be5fb71b9ffb121d" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.755491 13454 raft_consensus.cc:3037] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.755728 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb256c58a6714ec0be5fb71b9ffb121d" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.756028 13527 raft_consensus.cc:3037] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.758975 13527 raft_consensus.cc:2454] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.759419 13575 raft_consensus.cc:482] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.759542 13343 leader_election.cc:302] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.759622 13575 raft_consensus.cc:504] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.759907 13623 raft_consensus.cc:2781] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.760039 13623 raft_consensus.cc:686] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.760329 13623 consensus_queue.cc:237] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.760486 13575 leader_election.cc:288] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.761444 13454 raft_consensus.cc:2454] T bb256c58a6714ec0be5fb71b9ffb121d P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.761884 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b5a9a77ea47412ab97fc72dc71ae785" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.762203 13526 raft_consensus.cc:2454] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.761900 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b5a9a77ea47412ab97fc72dc71ae785" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.762481 13452 raft_consensus.cc:3037] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.762615 13453 raft_consensus.cc:2454] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.753950 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb256c58a6714ec0be5fb71b9ffb121d" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.763016 13343 leader_election.cc:302] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.763188 13528 raft_consensus.cc:2362] T bb256c58a6714ec0be5fb71b9ffb121d P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1. Re-sending same reply.
I20240503 14:12:51.755163 13621 leader_election.cc:288] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.764181 13621 raft_consensus.cc:2781] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.764389 13621 raft_consensus.cc:482] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.764561 13621 raft_consensus.cc:3037] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.766844 13588 consensus_queue.cc:1035] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:51.767946 13621 raft_consensus.cc:504] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.769356 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b5a9a77ea47412ab97fc72dc71ae785" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.769623 13453 raft_consensus.cc:3037] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.771356 13622 raft_consensus.cc:482] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.771530 13622 raft_consensus.cc:504] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.772298 13622 leader_election.cc:288] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.772771 13453 raft_consensus.cc:2454] T 1b5a9a77ea47412ab97fc72dc71ae785 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.773353 13344 leader_election.cc:302] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.773386 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f69eeea0d62e4e68abeccb65c95a8dd8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.773692 13622 raft_consensus.cc:2781] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.773862 13622 raft_consensus.cc:686] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.773725 13453 raft_consensus.cc:2454] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.774791 13344 leader_election.cc:302] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.774843 13622 consensus_queue.cc:237] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.774893 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1b5a9a77ea47412ab97fc72dc71ae785" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.775192 13575 raft_consensus.cc:2781] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.775323 13528 raft_consensus.cc:3037] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.775331 13575 raft_consensus.cc:482] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.775631 13575 raft_consensus.cc:3037] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.775820 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f69eeea0d62e4e68abeccb65c95a8dd8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.776008 13527 raft_consensus.cc:2454] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.777740 13569 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.777936 13569 ts_tablet_manager.cc:1367] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.038s
I20240503 14:12:51.778681 13575 raft_consensus.cc:504] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.778823 13569 raft_consensus.cc:348] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.779062 13569 raft_consensus.cc:374] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.779157 13569 raft_consensus.cc:729] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.780042 13575 leader_election.cc:288] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.780448 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f69eeea0d62e4e68abeccb65c95a8dd8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.780686 13527 raft_consensus.cc:3037] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.783459 13528 raft_consensus.cc:2454] T 1b5a9a77ea47412ab97fc72dc71ae785 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.783771 13527 raft_consensus.cc:2454] T f69eeea0d62e4e68abeccb65c95a8dd8 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.784230 13343 leader_election.cc:302] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.784507 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f69eeea0d62e4e68abeccb65c95a8dd8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.784673 13575 raft_consensus.cc:2781] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.784865 13453 raft_consensus.cc:3037] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.785192 13575 raft_consensus.cc:686] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.785614 13575 consensus_queue.cc:237] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.787261 13621 leader_election.cc:288] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.788159 13453 raft_consensus.cc:2454] T f69eeea0d62e4e68abeccb65c95a8dd8 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.779444 13569 consensus_queue.cc:260] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.789911 13595 raft_consensus.cc:482] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.790089 13595 raft_consensus.cc:504] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.790792 13595 leader_election.cc:288] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.791394 13274 catalog_manager.cc:5484] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.791694 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.791921 13378 raft_consensus.cc:2454] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.792340 13419 leader_election.cc:302] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.792641 13595 raft_consensus.cc:2781] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.792645 13569 ts_tablet_manager.cc:1398] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20240503 14:12:51.792784 13595 raft_consensus.cc:482] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.792870 13595 raft_consensus.cc:3037] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.795634 13569 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.795614 13595 raft_consensus.cc:504] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.796736 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.796948 13378 raft_consensus.cc:3037] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.797407 13569 tablet_bootstrap.cc:654] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.800010 13378 raft_consensus.cc:2454] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.800567 13419 leader_election.cc:302] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.800990 13576 raft_consensus.cc:2781] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.801182 13576 raft_consensus.cc:686] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.801496 13576 consensus_queue.cc:237] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.801718 13595 leader_election.cc:288] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.801807 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.802107 13527 raft_consensus.cc:3037] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.802083 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc278b18dbe543c797160688d0d08403" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.805115 13527 raft_consensus.cc:2454] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.806388 13528 raft_consensus.cc:3037] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.810648 13593 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:51.819516 13651 log.cc:924] Time spent T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8: Append to log took a long time: real 0.086s user 0.000s sys 0.000s
I20240503 14:12:51.826062 13588 raft_consensus.cc:482] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.826261 13588 raft_consensus.cc:504] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.827036 13588 leader_election.cc:288] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.828049 13576 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:51.828037 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.828838 13453 raft_consensus.cc:2454] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.829262 13493 leader_election.cc:302] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.830031 13627 raft_consensus.cc:2781] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.828028 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.830142 13627 raft_consensus.cc:482] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.830255 13627 raft_consensus.cc:3037] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.832134 13274 catalog_manager.cc:5484] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.833047 13627 raft_consensus.cc:504] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.830251 13378 raft_consensus.cc:2454] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.835289 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.835523 13377 raft_consensus.cc:3037] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.835772 13627 leader_election.cc:288] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.839576 13377 raft_consensus.cc:2454] T 325462c18cf14226ac695fcb5f0463c3 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.840193 13493 leader_election.cc:302] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.840631 13627 raft_consensus.cc:2781] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.840891 13627 raft_consensus.cc:686] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:51.841197 13627 consensus_queue.cc:237] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.842228 13274 catalog_manager.cc:5484] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.843045 13274 catalog_manager.cc:5484] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.841197 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "325462c18cf14226ac695fcb5f0463c3" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.850683 13452 raft_consensus.cc:3037] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.860177 13452 raft_consensus.cc:2454] T 325462c18cf14226ac695fcb5f0463c3 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.868954 13588 consensus_queue.cc:1035] T 2ca7f69e4b2f4cf3a9c5e262606c8960 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:51.873186 13570 tablet_bootstrap.cc:492] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.873409 13570 ts_tablet_manager.cc:1367] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.141s user 0.048s sys 0.059s
I20240503 14:12:51.873642 13274 catalog_manager.cc:5484] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:51.874850 13568 tablet_bootstrap.cc:492] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.874789 13570 raft_consensus.cc:348] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.875033 13570 raft_consensus.cc:374] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.876055 13569 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.876497 13568 ts_tablet_manager.cc:1367] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.159s user 0.018s sys 0.054s
I20240503 14:12:51.877364 13568 raft_consensus.cc:348] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.877632 13568 raft_consensus.cc:374] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.877722 13568 raft_consensus.cc:729] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.878094 13570 raft_consensus.cc:729] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.878006 13568 consensus_queue.cc:260] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.878765 13569 ts_tablet_manager.cc:1367] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.081s user 0.011s sys 0.031s
I20240503 14:12:51.878705 13568 ts_tablet_manager.cc:1398] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.878705 13570 consensus_queue.cc:260] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.879150 13568 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.879595 13569 raft_consensus.cc:348] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.879815 13569 raft_consensus.cc:374] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.879910 13569 raft_consensus.cc:729] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.880157 13569 consensus_queue.cc:260] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.880707 13569 ts_tablet_manager.cc:1398] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:51.881016 13568 tablet_bootstrap.cc:654] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.881120 13569 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.881546 13570 ts_tablet_manager.cc:1398] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20240503 14:12:51.881861 13570 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.882844 13569 tablet_bootstrap.cc:654] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.883553 13570 tablet_bootstrap.cc:654] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.887234 13569 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.887418 13569 ts_tablet_manager.cc:1367] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20240503 14:12:51.888092 13569 raft_consensus.cc:348] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.888284 13569 raft_consensus.cc:374] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.888381 13569 raft_consensus.cc:729] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.888615 13569 consensus_queue.cc:260] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.889094 13569 ts_tablet_manager.cc:1398] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:51.889535 13569 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.890151 13568 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.890314 13568 ts_tablet_manager.cc:1367] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20240503 14:12:51.891147 13570 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.892195 13568 raft_consensus.cc:348] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.892469 13588 raft_consensus.cc:482] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.892478 13568 raft_consensus.cc:374] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.892680 13588 raft_consensus.cc:504] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.893538 13570 ts_tablet_manager.cc:1367] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20240503 14:12:51.893996 13588 leader_election.cc:288] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.893966 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.894186 13569 tablet_bootstrap.cc:654] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.894268 13379 raft_consensus.cc:2454] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.894366 13570 raft_consensus.cc:348] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.894590 13570 raft_consensus.cc:374] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.894670 13570 raft_consensus.cc:729] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.894614 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.894728 13493 leader_election.cc:302] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.894840 13453 raft_consensus.cc:2454] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.894941 13570 consensus_queue.cc:260] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.895206 13588 raft_consensus.cc:2781] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.895319 13588 raft_consensus.cc:482] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.895418 13588 raft_consensus.cc:3037] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.895525 13570 ts_tablet_manager.cc:1398] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:51.895891 13570 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.897269 13569 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.897439 13569 ts_tablet_manager.cc:1367] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20240503 14:12:51.897671 13570 tablet_bootstrap.cc:654] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.897815 13588 raft_consensus.cc:504] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.898291 13569 raft_consensus.cc:348] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.898545 13569 raft_consensus.cc:374] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.898634 13569 raft_consensus.cc:729] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.898909 13569 consensus_queue.cc:260] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.899116 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.899320 13379 raft_consensus.cc:3037] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.900452 13569 ts_tablet_manager.cc:1398] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:12:51.900835 13569 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.902150 13379 raft_consensus.cc:2454] T b61dac9e02af42bf90fe1c8d9409b022 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.893939 13568 raft_consensus.cc:729] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.902832 13627 raft_consensus.cc:482] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.902999 13627 raft_consensus.cc:504] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.902964 13568 consensus_queue.cc:260] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.904341 13569 tablet_bootstrap.cc:654] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.905223 13627 leader_election.cc:288] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.906674 13493 leader_election.cc:302] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.908223 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:51.908795 13493 leader_election.cc:341] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.908929 13588 leader_election.cc:288] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.908836 13627 raft_consensus.cc:2781] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.908823 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.909198 13627 raft_consensus.cc:686] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:51.908789 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b61dac9e02af42bf90fe1c8d9409b022" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.909924 13452 raft_consensus.cc:3037] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.909940 13627 consensus_queue.cc:237] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.912123 13568 ts_tablet_manager.cc:1398] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.013s user 0.000s sys 0.002s
I20240503 14:12:51.912946 13452 raft_consensus.cc:2454] T b61dac9e02af42bf90fe1c8d9409b022 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:51.913439 13568 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.913551 13570 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
W20240503 14:12:51.913523 13493 leader_election.cc:341] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.914029 13493 leader_election.cc:302] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.914870 13627 raft_consensus.cc:2726] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.915114 13570 ts_tablet_manager.cc:1367] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.002s
I20240503 14:12:51.916322 13570 raft_consensus.cc:348] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.916563 13570 raft_consensus.cc:374] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.916664 13570 raft_consensus.cc:729] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.916673 13274 catalog_manager.cc:5484] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:51.916913 13570 consensus_queue.cc:260] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.917397 13569 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.917460 13570 ts_tablet_manager.cc:1398] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:51.917567 13569 ts_tablet_manager.cc:1367] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.004s
I20240503 14:12:51.917572 13568 tablet_bootstrap.cc:654] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.918100 13622 raft_consensus.cc:482] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.918238 13622 raft_consensus.cc:504] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.918416 13569 raft_consensus.cc:348] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.918581 13569 raft_consensus.cc:374] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.918678 13569 raft_consensus.cc:729] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.918937 13569 consensus_queue.cc:260] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.919611 13622 leader_election.cc:288] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.919648 13569 ts_tablet_manager.cc:1398] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.919948 13569 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:51.920464 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.920691 13528 raft_consensus.cc:2454] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.922201 13569 tablet_bootstrap.cc:654] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.922758 13343 leader_election.cc:302] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.924011 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.924301 13452 raft_consensus.cc:2454] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:51.924944 13622 raft_consensus.cc:2781] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.925093 13622 raft_consensus.cc:482] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.925192 13622 raft_consensus.cc:3037] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.927162 13570 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.928854 13622 raft_consensus.cc:504] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.932030 13622 leader_election.cc:288] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.929534 13570 tablet_bootstrap.cc:654] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.932176 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.932436 13528 raft_consensus.cc:3037] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.935796 13528 raft_consensus.cc:2454] T ba6a0edf6cd84b4989c9a549936bb5aa P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.937631 13343 leader_election.cc:302] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.930356 13593 raft_consensus.cc:482] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.938088 13593 raft_consensus.cc:504] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.938896 13593 leader_election.cc:288] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.939589 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.939818 13527 raft_consensus.cc:2454] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.939954 13569 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:51.940127 13569 ts_tablet_manager.cc:1367] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.006s
I20240503 14:12:51.940297 13418 leader_election.cc:302] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.940353 13568 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.940562 13568 ts_tablet_manager.cc:1367] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.027s user 0.010s sys 0.014s
I20240503 14:12:51.940853 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.940984 13569 raft_consensus.cc:348] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.941185 13569 raft_consensus.cc:374] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.941265 13622 raft_consensus.cc:2781] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.941272 13569 raft_consensus.cc:729] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.941419 13622 raft_consensus.cc:686] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:51.941387 13568 raft_consensus.cc:348] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.941664 13568 raft_consensus.cc:374] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.941565 13569 consensus_queue.cc:260] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.941745 13568 raft_consensus.cc:729] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.941705 13622 consensus_queue.cc:237] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.942070 13568 consensus_queue.cc:260] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:51.943032 13419 leader_election.cc:341] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.943192 13568 ts_tablet_manager.cc:1398] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:12:51.943418 13593 raft_consensus.cc:2781] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.943524 13593 raft_consensus.cc:482] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.943557 13568 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.943629 13593 raft_consensus.cc:3037] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.945111 13569 ts_tablet_manager.cc:1398] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 14:12:51.945562 13568 tablet_bootstrap.cc:654] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.946153 13627 raft_consensus.cc:482] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.946997 13627 raft_consensus.cc:504] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.949059 13588 raft_consensus.cc:482] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.949246 13588 raft_consensus.cc:504] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.950795 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44014ff0028742f6a0241f820367cae0" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.950820 13627 leader_election.cc:288] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.950942 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f4aea14dec54042ab565a0bf2ec4a8b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.950815 13588 leader_election.cc:288] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:51.950964 13593 raft_consensus.cc:504] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.951239 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba6a0edf6cd84b4989c9a549936bb5aa" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:51.951539 13453 raft_consensus.cc:2454] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.951543 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f4aea14dec54042ab565a0bf2ec4a8b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.952724 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:51.953138 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44014ff0028742f6a0241f820367cae0" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.953357 13377 raft_consensus.cc:2454] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.952585 13379 raft_consensus.cc:2454] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:51.953840 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.954145 13528 raft_consensus.cc:3037] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
W20240503 14:12:51.954352 13419 leader_election.cc:341] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.955271 13593 leader_election.cc:288] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.956816 13593 raft_consensus.cc:482] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.957016 13593 raft_consensus.cc:504] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.957370 13528 raft_consensus.cc:2454] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.957798 13418 leader_election.cc:302] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:51.957638 13274 catalog_manager.cc:5484] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:51.958268 13595 raft_consensus.cc:2781] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.958210 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:51.958413 13595 raft_consensus.cc:686] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.958436 13379 raft_consensus.cc:2454] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.958695 13595 consensus_queue.cc:237] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.958921 13419 leader_election.cc:302] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:51.959853 13576 raft_consensus.cc:2781] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.959982 13576 raft_consensus.cc:482] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:51.960072 13576 raft_consensus.cc:3037] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.962281 13593 leader_election.cc:288] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.962747 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.962983 13527 raft_consensus.cc:2454] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:51.964323 13576 raft_consensus.cc:504] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.965000 13576 leader_election.cc:288] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.965580 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:51.965806 13527 raft_consensus.cc:3037] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.967842 13570 tablet_bootstrap.cc:492] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.967916 13568 tablet_bootstrap.cc:492] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.968050 13568 ts_tablet_manager.cc:1367] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.005s
I20240503 14:12:51.968052 13570 ts_tablet_manager.cc:1367] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.028s
I20240503 14:12:51.968449 13527 raft_consensus.cc:2454] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:51.968951 13570 raft_consensus.cc:348] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.969209 13570 raft_consensus.cc:374] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.969292 13570 raft_consensus.cc:729] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.969266 13418 leader_election.cc:302] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.969638 13570 consensus_queue.cc:260] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.969949 13568 raft_consensus.cc:348] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.970599 13570 ts_tablet_manager.cc:1398] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:51.970230 13576 consensus_queue.cc:1035] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:51.970974 13570 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.970691 13568 raft_consensus.cc:374] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.971165 13568 raft_consensus.cc:729] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.970122 13593 raft_consensus.cc:2781] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:51.971534 13593 raft_consensus.cc:686] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:51.971632 13568 consensus_queue.cc:260] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.972015 13593 consensus_queue.cc:237] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.972837 13570 tablet_bootstrap.cc:654] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.974594 13568 ts_tablet_manager.cc:1398] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240503 14:12:51.974946 13568 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:51.976902 13568 tablet_bootstrap.cc:654] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.978024 13622 raft_consensus.cc:482] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:51.978235 13622 raft_consensus.cc:504] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.979027 13622 leader_election.cc:288] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:51.979202 13570 tablet_bootstrap.cc:492] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:51.979374 13570 ts_tablet_manager.cc:1367] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20240503 14:12:51.979539 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:51.979801 13526 raft_consensus.cc:2379] T 0008a5823a8f40d2ba13be37a59f4250 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:51.980193 13570 raft_consensus.cc:348] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.980432 13570 raft_consensus.cc:374] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:51.980553 13570 raft_consensus.cc:729] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:51.980607 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0008a5823a8f40d2ba13be37a59f4250" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:51.980844 13570 consensus_queue.cc:260] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:51.981472 13344 leader_election.cc:302] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:51.981534 13570 ts_tablet_manager.cc:1398] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:51.982184 13570 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:51.982399 13622 raft_consensus.cc:3037] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.984760 13570 tablet_bootstrap.cc:654] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.987219 13622 raft_consensus.cc:2726] T 0008a5823a8f40d2ba13be37a59f4250 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:51.990456 13569 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
W20240503 14:12:51.990563 13493 leader_election.cc:341] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:51.990872 13493 leader_election.cc:302] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8
I20240503 14:12:51.991586 13493 leader_election.cc:302] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:51.992031 13452 raft_consensus.cc:3037] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:51.992614 13568 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:51.993904 13588 raft_consensus.cc:2781] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:51.996594 13452 raft_consensus.cc:2454] T ba6a0edf6cd84b4989c9a549936bb5aa P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:51.998262 13569 tablet_bootstrap.cc:654] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:51.999954 13570 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.000557 13568 ts_tablet_manager.cc:1367] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240503 14:12:52.000623 13627 raft_consensus.cc:2781] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.000756 13627 raft_consensus.cc:482] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.000891 13627 raft_consensus.cc:3037] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.001540 13568 raft_consensus.cc:348] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.001839 13568 raft_consensus.cc:374] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.001945 13568 raft_consensus.cc:729] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.002071 13588 raft_consensus.cc:482] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.002213 13588 raft_consensus.cc:3037] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.002285 13568 consensus_queue.cc:260] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.005165 13588 raft_consensus.cc:504] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.005084 13274 catalog_manager.cc:5484] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.007939 13570 ts_tablet_manager.cc:1367] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.005s
I20240503 14:12:52.010807 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44014ff0028742f6a0241f820367cae0" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.011097 13588 leader_election.cc:288] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.011214 13568 ts_tablet_manager.cc:1398] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 14:12:52.012190 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44014ff0028742f6a0241f820367cae0" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.012437 13452 raft_consensus.cc:3037] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.012198 13379 raft_consensus.cc:3037] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.012117 13570 raft_consensus.cc:348] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.013702 13622 consensus_queue.cc:1035] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240503 14:12:52.015501 13569 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.016222 13627 raft_consensus.cc:504] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.016816 13568 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
W20240503 14:12:52.013612 13419 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.12.1.129:38667, user_credentials={real_user=slave}} blocked reactor thread for 50394.1us
I20240503 14:12:52.019363 13627 leader_election.cc:288] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.019515 13681 consensus_queue.cc:1035] T 49bed4cea1814a33870695d2a9c8ba9b P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.020382 13569 ts_tablet_manager.cc:1367] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.004s
I20240503 14:12:52.021344 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f4aea14dec54042ab565a0bf2ec4a8b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.024178 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "514eb3d2023740edb111da5cc6b6de35" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.024204 13588 consensus_queue.cc:1035] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.024423 13377 raft_consensus.cc:3037] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.026860 13377 raft_consensus.cc:2454] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.028987 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f4aea14dec54042ab565a0bf2ec4a8b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.029551 13575 consensus_queue.cc:1035] T ddb2aad6a2524734ad7fb9067db7372c P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20240503 14:12:52.031051 13378 raft_consensus.cc:3037] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.043401 13453 raft_consensus.cc:3037] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.045964 13570 raft_consensus.cc:374] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.048764 13379 raft_consensus.cc:2454] T 44014ff0028742f6a0241f820367cae0 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.052531 13570 raft_consensus.cc:729] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.053906 13575 consensus_queue.cc:1035] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.056280 13575 raft_consensus.cc:482] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.056469 13575 raft_consensus.cc:504] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.056988 13570 consensus_queue.cc:260] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.057669 13570 ts_tablet_manager.cc:1398] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.050s user 0.002s sys 0.000s
I20240503 14:12:52.058224 13570 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.058280 13575 leader_election.cc:288] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.058653 13378 raft_consensus.cc:2454] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.058959 13568 tablet_bootstrap.cc:654] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.059813 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.060338 13452 raft_consensus.cc:2454] T 44014ff0028742f6a0241f820367cae0 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.074565 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1f84c6ec1d449f591d23ccf8b6d9a0f" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.074927 13526 raft_consensus.cc:2379] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:52.075196 13453 raft_consensus.cc:2454] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.077332 13569 raft_consensus.cc:348] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.078074 13575 consensus_queue.cc:1035] T cbff04261a5a4f37a39b9e0a8dada8aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.063097 13588 consensus_queue.cc:1035] T 8d2156b9064a4e6d972b5a10af68bada P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20240503 14:12:52.080411 13493 leader_election.cc:302] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.080884 13344 leader_election.cc:302] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:52.080950 13493 leader_election.cc:302] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.081207 13575 raft_consensus.cc:3037] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.080960 13588 raft_consensus.cc:2781] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.088841 13588 raft_consensus.cc:686] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.092142 13588 consensus_queue.cc:237] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.092311 13569 raft_consensus.cc:374] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.092438 13569 raft_consensus.cc:729] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.091665 13575 raft_consensus.cc:2726] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.093899 13627 raft_consensus.cc:2781] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.094072 13627 raft_consensus.cc:686] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.094302 13627 consensus_queue.cc:237] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.092648 13569 consensus_queue.cc:260] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.096426 13623 raft_consensus.cc:482] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.096562 13623 raft_consensus.cc:504] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.096279 13622 consensus_queue.cc:1035] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20240503 14:12:52.109170 13588 raft_consensus.cc:482] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.113736 13573 raft_consensus.cc:482] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.113948 13573 raft_consensus.cc:504] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.120319 13623 leader_election.cc:288] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.109395 13588 raft_consensus.cc:504] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.121016 13593 consensus_queue.cc:1035] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20240503 14:12:52.121553 13588 leader_election.cc:288] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.120996 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.121954 13379 raft_consensus.cc:2454] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.122128 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.122551 13493 leader_election.cc:302] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.122589 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.122021 13573 leader_election.cc:288] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.123072 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.122924 13588 raft_consensus.cc:2781] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.123344 13588 raft_consensus.cc:482] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.123440 13588 raft_consensus.cc:3037] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.124253 13450 raft_consensus.cc:2454] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.124594 13344 leader_election.cc:302] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.124887 13622 raft_consensus.cc:2781] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.124962 13622 raft_consensus.cc:482] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.125022 13622 raft_consensus.cc:3037] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
W20240503 14:12:52.123796 13493 leader_election.cc:341] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.127174 13570 tablet_bootstrap.cc:654] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.127348 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.127533 13527 raft_consensus.cc:2454] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.128382 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:52.128979 13493 leader_election.cc:341] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.129096 13493 leader_election.cc:302] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
W20240503 14:12:52.129475 13493 leader_election.cc:341] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.129644 13573 raft_consensus.cc:2726] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.142201 13588 raft_consensus.cc:504] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.154325 13588 leader_election.cc:288] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.154552 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.154824 13375 raft_consensus.cc:3037] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.153352 13275 catalog_manager.cc:5484] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.158145 13622 raft_consensus.cc:504] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.159670 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.159906 13450 raft_consensus.cc:3037] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.160704 13569 ts_tablet_manager.cc:1398] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.140s user 0.003s sys 0.016s
I20240503 14:12:52.161123 13569 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.161574 13570 tablet_bootstrap.cc:492] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.161864 13570 ts_tablet_manager.cc:1367] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.104s user 0.007s sys 0.001s
I20240503 14:12:52.161710 13622 leader_election.cc:288] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.164089 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
W20240503 14:12:52.164808 13493 leader_election.cc:341] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.164721 13570 raft_consensus.cc:348] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.165095 13570 raft_consensus.cc:374] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.165228 13570 raft_consensus.cc:729] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.165553 13570 consensus_queue.cc:260] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.166661 13570 ts_tablet_manager.cc:1398] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 14:12:52.167210 13570 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.168393 13588 raft_consensus.cc:482] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.168541 13588 raft_consensus.cc:504] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.169221 13588 leader_election.cc:288] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.170462 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.170553 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:52.171048 13493 leader_election.cc:341] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:52.171270 13493 leader_election.cc:341] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.171362 13493 leader_election.cc:302] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.170469 13450 raft_consensus.cc:2454] T de013d0b1c964223939e190d1ada54cd P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.171629 13627 raft_consensus.cc:2726] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.171954 13344 leader_election.cc:302] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.172194 13622 raft_consensus.cc:2781] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.172416 13622 raft_consensus.cc:686] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.171962 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de013d0b1c964223939e190d1ada54cd" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.172958 13528 raft_consensus.cc:3037] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.173426 13593 consensus_queue.cc:1035] T 0008a5823a8f40d2ba13be37a59f4250 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.175036 13570 tablet_bootstrap.cc:654] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.172905 13622 consensus_queue.cc:237] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.183306 13276 catalog_manager.cc:5484] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.184053 13276 catalog_manager.cc:5484] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.187482 13375 raft_consensus.cc:2454] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.189065 13493 leader_election.cc:302] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8
I20240503 14:12:52.189513 13588 raft_consensus.cc:2781] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.189653 13588 raft_consensus.cc:686] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.189888 13588 consensus_queue.cc:237] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.190598 13569 tablet_bootstrap.cc:654] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.192756 13568 tablet_bootstrap.cc:492] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.192909 13568 ts_tablet_manager.cc:1367] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.181s user 0.008s sys 0.007s
I20240503 14:12:52.193490 13568 raft_consensus.cc:348] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.193696 13568 raft_consensus.cc:374] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.193756 13568 raft_consensus.cc:729] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.193946 13568 consensus_queue.cc:260] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.194545 13568 ts_tablet_manager.cc:1398] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.194865 13568 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.196108 13568 tablet_bootstrap.cc:654] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.197937 13595 raft_consensus.cc:482] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.198107 13595 raft_consensus.cc:504] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.198787 13595 leader_election.cc:288] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.200865 13575 consensus_queue.cc:1035] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.201290 13621 consensus_queue.cc:1035] T 11392c75b3284fa892b06d7e83b09aa2 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.204941 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.205188 13379 raft_consensus.cc:2454] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.205688 13419 leader_election.cc:302] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.206089 13595 raft_consensus.cc:2781] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.206172 13595 raft_consensus.cc:482] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.206233 13595 raft_consensus.cc:3037] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.206328 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.206578 13527 raft_consensus.cc:2454] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.207429 13593 raft_consensus.cc:482] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.207571 13593 raft_consensus.cc:504] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.207935 13575 consensus_queue.cc:1035] T f69eeea0d62e4e68abeccb65c95a8dd8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.208225 13593 leader_election.cc:288] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.208714 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.208906 13379 raft_consensus.cc:2454] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.208998 13595 raft_consensus.cc:504] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.209254 13419 leader_election.cc:302] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.209501 13593 raft_consensus.cc:2781] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.209563 13593 raft_consensus.cc:482] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.209601 13595 leader_election.cc:288] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.209619 13593 raft_consensus.cc:3037] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.210191 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.210207 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.210363 13526 raft_consensus.cc:3037] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.211305 13276 catalog_manager.cc:5484] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.212443 13593 raft_consensus.cc:504] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.212858 13526 raft_consensus.cc:2454] T e7bd97becb1b48589913cf52da1ab41d P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.213104 13593 leader_election.cc:288] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.210367 13527 raft_consensus.cc:2454] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.213747 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.213948 13375 raft_consensus.cc:3037] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.217022 13375 raft_consensus.cc:2454] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.217536 13418 leader_election.cc:302] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.217710 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcefb8b7ac4f4a9cad6b9fa6cc81f73c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.217886 13527 raft_consensus.cc:3037] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.218295 13419 leader_election.cc:302] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.218583 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7bd97becb1b48589913cf52da1ab41d" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.218722 13379 raft_consensus.cc:3037] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.220266 13595 raft_consensus.cc:2781] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.220546 13576 raft_consensus.cc:2781] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.220649 13576 raft_consensus.cc:686] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:52.220655 13527 raft_consensus.cc:2454] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.220901 13576 consensus_queue.cc:237] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.221190 13379 raft_consensus.cc:2454] T e7bd97becb1b48589913cf52da1ab41d P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.222549 13595 raft_consensus.cc:686] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:52.222959 13569 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.223340 13569 ts_tablet_manager.cc:1367] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.062s user 0.003s sys 0.000s
I20240503 14:12:52.223814 13568 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.225273 13569 raft_consensus.cc:348] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.225275 13568 ts_tablet_manager.cc:1367] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20240503 14:12:52.223071 13595 consensus_queue.cc:237] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.227392 13570 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.228691 13528 raft_consensus.cc:2454] T de013d0b1c964223939e190d1ada54cd P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.228822 13568 raft_consensus.cc:348] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.229041 13568 raft_consensus.cc:374] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.229143 13568 raft_consensus.cc:729] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.229378 13568 consensus_queue.cc:260] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.230026 13568 ts_tablet_manager.cc:1398] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:52.230392 13568 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.230644 13274 catalog_manager.cc:5484] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.232080 13568 tablet_bootstrap.cc:654] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.234651 13569 raft_consensus.cc:374] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.234805 13569 raft_consensus.cc:729] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.234726 13622 consensus_queue.cc:1035] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.235060 13569 consensus_queue.cc:260] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.235623 13569 ts_tablet_manager.cc:1398] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20240503 14:12:52.235934 13569 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.237418 13569 tablet_bootstrap.cc:654] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.238061 13570 ts_tablet_manager.cc:1367] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.002s
I20240503 14:12:52.238204 13275 catalog_manager.cc:5484] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.238806 13570 raft_consensus.cc:348] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.239070 13570 raft_consensus.cc:374] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.239159 13570 raft_consensus.cc:729] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.239432 13275 catalog_manager.cc:5484] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.239830 13570 consensus_queue.cc:260] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.240370 13570 ts_tablet_manager.cc:1398] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.240685 13570 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.241958 13621 consensus_queue.cc:1035] T 1b5a9a77ea47412ab97fc72dc71ae785 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.242249 13570 tablet_bootstrap.cc:654] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.244926 13570 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.245100 13570 ts_tablet_manager.cc:1367] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240503 14:12:52.245769 13570 raft_consensus.cc:348] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.246026 13570 raft_consensus.cc:374] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.246145 13570 raft_consensus.cc:729] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.246392 13570 consensus_queue.cc:260] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.247088 13570 ts_tablet_manager.cc:1398] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:52.247381 13570 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.248505 13568 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.248679 13568 ts_tablet_manager.cc:1367] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.003s
I20240503 14:12:52.249006 13570 tablet_bootstrap.cc:654] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.249466 13568 raft_consensus.cc:348] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.249691 13568 raft_consensus.cc:374] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.249799 13568 raft_consensus.cc:729] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.250133 13568 consensus_queue.cc:260] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.250988 13570 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.251168 13570 ts_tablet_manager.cc:1367] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:52.251818 13570 raft_consensus.cc:348] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.252039 13570 raft_consensus.cc:374] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.252142 13570 raft_consensus.cc:729] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.252410 13570 consensus_queue.cc:260] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.253067 13570 ts_tablet_manager.cc:1398] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.253187 13568 ts_tablet_manager.cc:1398] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20240503 14:12:52.253413 13570 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.253444 13568 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.255321 13570 tablet_bootstrap.cc:654] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.258203 13568 tablet_bootstrap.cc:654] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.258936 13569 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.259162 13569 ts_tablet_manager.cc:1367] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20240503 14:12:52.259954 13568 tablet_bootstrap.cc:492] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.259974 13569 raft_consensus.cc:348] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.260150 13568 ts_tablet_manager.cc:1367] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240503 14:12:52.260206 13570 tablet_bootstrap.cc:492] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.260761 13569 raft_consensus.cc:374] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.260779 13570 ts_tablet_manager.cc:1367] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20240503 14:12:52.260886 13569 raft_consensus.cc:729] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.260780 13568 raft_consensus.cc:348] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.261094 13568 raft_consensus.cc:374] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.261190 13568 raft_consensus.cc:729] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.261148 13569 consensus_queue.cc:260] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.261492 13570 raft_consensus.cc:348] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.261463 13568 consensus_queue.cc:260] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.261669 13570 raft_consensus.cc:374] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.261763 13570 raft_consensus.cc:729] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.261862 13569 ts_tablet_manager.cc:1398] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:52.262048 13570 consensus_queue.cc:260] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.262220 13569 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.263340 13570 ts_tablet_manager.cc:1398] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:52.263659 13570 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.263655 13569 tablet_bootstrap.cc:654] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.265450 13569 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.265625 13569 ts_tablet_manager.cc:1367] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:12:52.266005 13568 ts_tablet_manager.cc:1398] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240503 14:12:52.266356 13568 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.266366 13569 raft_consensus.cc:348] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.266675 13569 raft_consensus.cc:374] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.266763 13569 raft_consensus.cc:729] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.267019 13569 consensus_queue.cc:260] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.267635 13569 ts_tablet_manager.cc:1398] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.267824 13568 tablet_bootstrap.cc:654] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.267825 13570 tablet_bootstrap.cc:654] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.267946 13569 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.269280 13569 tablet_bootstrap.cc:654] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.269567 13588 raft_consensus.cc:482] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.269735 13588 raft_consensus.cc:504] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.270859 13588 leader_election.cc:288] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.271384 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.271780 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:52.272284 13493 leader_election.cc:341] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:52.272521 13493 leader_election.cc:341] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.272627 13493 leader_election.cc:302] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.273041 13588 raft_consensus.cc:2726] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.275943 13570 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.276168 13570 ts_tablet_manager.cc:1367] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20240503 14:12:52.276196 13568 tablet_bootstrap.cc:492] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.276400 13568 ts_tablet_manager.cc:1367] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20240503 14:12:52.277011 13570 raft_consensus.cc:348] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.277359 13570 raft_consensus.cc:374] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.277464 13570 raft_consensus.cc:729] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.277021 13568 raft_consensus.cc:348] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.277812 13568 raft_consensus.cc:374] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.277942 13568 raft_consensus.cc:729] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.277815 13570 consensus_queue.cc:260] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.278177 13569 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.278347 13569 ts_tablet_manager.cc:1367] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20240503 14:12:52.278223 13568 consensus_queue.cc:260] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.278898 13568 ts_tablet_manager.cc:1398] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.279059 13569 raft_consensus.cc:348] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.279258 13569 raft_consensus.cc:374] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.279268 13568 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.279367 13569 raft_consensus.cc:729] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.279582 13569 consensus_queue.cc:260] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.279680 13593 raft_consensus.cc:482] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.279860 13593 raft_consensus.cc:504] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.280207 13569 ts_tablet_manager.cc:1398] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.280505 13569 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.280581 13593 leader_election.cc:288] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.281061 13568 tablet_bootstrap.cc:654] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.281136 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.281345 13525 raft_consensus.cc:2454] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.281920 13569 tablet_bootstrap.cc:654] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.282039 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.282228 13379 raft_consensus.cc:2454] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.282776 13570 ts_tablet_manager.cc:1398] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20240503 14:12:52.282903 13419 leader_election.cc:302] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.283185 13570 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.284263 13595 raft_consensus.cc:2781] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.284373 13595 raft_consensus.cc:482] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.284415 13588 raft_consensus.cc:482] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.284495 13595 raft_consensus.cc:3037] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.284606 13588 raft_consensus.cc:504] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.284905 13570 tablet_bootstrap.cc:654] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.285295 13588 leader_election.cc:288] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.285710 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.285995 13593 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:52.286273 13493 leader_election.cc:341] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.286585 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:52.286998 13493 leader_election.cc:341] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.287173 13493 leader_election.cc:302] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.287654 13573 raft_consensus.cc:2726] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.292254 13595 raft_consensus.cc:504] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.293179 13595 leader_election.cc:288] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.294142 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.294432 13379 raft_consensus.cc:3037] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.294368 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a85fc6b00d9f4d6e8143448310037622" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.294622 13528 raft_consensus.cc:3037] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.297670 13528 raft_consensus.cc:2454] T a85fc6b00d9f4d6e8143448310037622 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.298902 13418 leader_election.cc:302] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.299657 13595 raft_consensus.cc:2781] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.299896 13595 raft_consensus.cc:686] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:52.300247 13595 consensus_queue.cc:237] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.304001 13681 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:52.311244 13325 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 14:12:52.297672 13379 raft_consensus.cc:2454] T a85fc6b00d9f4d6e8143448310037622 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.314589 13568 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.316226 13568 ts_tablet_manager.cc:1367] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.037s user 0.009s sys 0.001s
I20240503 14:12:52.317227 13568 raft_consensus.cc:348] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.317685 13568 raft_consensus.cc:374] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.317829 13568 raft_consensus.cc:729] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.318449 13588 raft_consensus.cc:482] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.318411 13568 consensus_queue.cc:260] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.318681 13588 raft_consensus.cc:504] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.319299 13568 ts_tablet_manager.cc:1398] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:12:52.319633 13588 leader_election.cc:288] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.319871 13568 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.321040 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b65a06703c4e309a69e11211909f8f" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.321367 13450 raft_consensus.cc:2454] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.322036 13493 leader_election.cc:302] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.322134 13568 tablet_bootstrap.cc:654] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.322438 13588 raft_consensus.cc:2781] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.322603 13588 raft_consensus.cc:482] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.322726 13588 raft_consensus.cc:3037] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.326903 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b65a06703c4e309a69e11211909f8f" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.327282 13379 raft_consensus.cc:2454] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.328312 13588 raft_consensus.cc:504] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.329738 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b65a06703c4e309a69e11211909f8f" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.330040 13379 raft_consensus.cc:3037] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.331406 13568 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.331702 13568 ts_tablet_manager.cc:1367] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20240503 14:12:52.332716 13568 raft_consensus.cc:348] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.333026 13568 raft_consensus.cc:374] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.333189 13568 raft_consensus.cc:729] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.333510 13568 consensus_queue.cc:260] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.334215 13568 ts_tablet_manager.cc:1398] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.334610 13568 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.334686 13621 consensus_queue.cc:1035] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.333328 13379 raft_consensus.cc:2454] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.335361 13493 leader_election.cc:302] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.335841 13627 raft_consensus.cc:2781] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.336050 13627 raft_consensus.cc:686] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.336349 13627 consensus_queue.cc:237] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.336716 13568 tablet_bootstrap.cc:654] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.337208 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2b65a06703c4e309a69e11211909f8f" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.337455 13450 raft_consensus.cc:3037] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.340571 13450 raft_consensus.cc:2454] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.341815 13588 leader_election.cc:288] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.344481 13575 consensus_queue.cc:1035] T bb256c58a6714ec0be5fb71b9ffb121d P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.344611 13276 catalog_manager.cc:5484] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.354226 13568 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.354749 13568 ts_tablet_manager.cc:1367] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s
I20240503 14:12:52.355801 13569 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.354269 13588 raft_consensus.cc:482] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.356055 13569 ts_tablet_manager.cc:1367] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.076s user 0.035s sys 0.024s
I20240503 14:12:52.356200 13588 raft_consensus.cc:504] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.357075 13588 leader_election.cc:288] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.355640 13568 raft_consensus.cc:348] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.357439 13568 raft_consensus.cc:374] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.357568 13568 raft_consensus.cc:729] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.357880 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d492b984954755969aedb2c1bf7eda" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.357965 13568 consensus_queue.cc:260] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.358222 13451 raft_consensus.cc:2454] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.357872 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d492b984954755969aedb2c1bf7eda" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.358151 13569 raft_consensus.cc:348] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.358549 13569 raft_consensus.cc:374] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.358646 13569 raft_consensus.cc:729] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
W20240503 14:12:52.358932 13493 leader_election.cc:341] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.359020 13569 consensus_queue.cc:260] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.359190 13493 leader_election.cc:302] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.359730 13627 raft_consensus.cc:2781] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.359771 13569 ts_tablet_manager.cc:1398] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:52.359846 13627 raft_consensus.cc:482] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.359967 13627 raft_consensus.cc:3037] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.360205 13569 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.360985 13696 consensus_queue.cc:1035] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.361588 13568 ts_tablet_manager.cc:1398] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240503 14:12:52.361965 13568 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.362200 13569 tablet_bootstrap.cc:654] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.363651 13568 tablet_bootstrap.cc:654] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.366294 13627 raft_consensus.cc:504] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.367684 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d492b984954755969aedb2c1bf7eda" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:52.368320 13493 leader_election.cc:341] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.368711 13627 leader_election.cc:288] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.369385 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82d492b984954755969aedb2c1bf7eda" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.369602 13451 raft_consensus.cc:3037] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.373463 13451 raft_consensus.cc:2454] T 82d492b984954755969aedb2c1bf7eda P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.374229 13493 leader_election.cc:302] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.374809 13627 raft_consensus.cc:2781] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.375221 13573 raft_consensus.cc:482] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.375367 13573 raft_consensus.cc:504] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.376174 13573 leader_election.cc:288] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.376853 13627 raft_consensus.cc:686] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.377175 13627 consensus_queue.cc:237] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.378526 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1f8fbaaef34325ab780e134bcd9d6b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.378800 13376 raft_consensus.cc:2454] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.379310 13493 leader_election.cc:302] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.379628 13573 raft_consensus.cc:2781] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.379750 13573 raft_consensus.cc:482] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.379848 13573 raft_consensus.cc:3037] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.384231 13573 raft_consensus.cc:504] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.386812 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1f8fbaaef34325ab780e134bcd9d6b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.387158 13376 raft_consensus.cc:3037] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.391340 13376 raft_consensus.cc:2454] T 3d1f8fbaaef34325ab780e134bcd9d6b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.392060 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1f8fbaaef34325ab780e134bcd9d6b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.392385 13493 leader_election.cc:302] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.392772 13696 raft_consensus.cc:2781] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.392943 13696 raft_consensus.cc:686] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.393283 13696 consensus_queue.cc:237] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.394752 13451 raft_consensus.cc:2454] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.397070 13573 leader_election.cc:288] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.397931 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d1f8fbaaef34325ab780e134bcd9d6b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.398240 13451 raft_consensus.cc:3037] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.405589 13451 raft_consensus.cc:2454] T 3d1f8fbaaef34325ab780e134bcd9d6b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.410907 13575 consensus_queue.cc:1035] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.415426 13593 raft_consensus.cc:482] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.415670 13593 raft_consensus.cc:504] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.416430 13593 leader_election.cc:288] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.417824 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fec024e5ae7c43ebac0fb6f813701797" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.418133 13525 raft_consensus.cc:2454] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.418637 13418 leader_election.cc:302] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.419226 13576 raft_consensus.cc:2781] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.419348 13576 raft_consensus.cc:482] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.419461 13576 raft_consensus.cc:3037] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.422362 13276 catalog_manager.cc:5484] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.423355 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fec024e5ae7c43ebac0fb6f813701797" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.423439 13576 raft_consensus.cc:504] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.424302 13575 raft_consensus.cc:482] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.424468 13575 raft_consensus.cc:504] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.424710 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fec024e5ae7c43ebac0fb6f813701797" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.425091 13575 leader_election.cc:288] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.425639 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.425873 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:52.426113 13344 leader_election.cc:341] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.426167 13525 raft_consensus.cc:2454] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.426692 13343 leader_election.cc:302] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8
I20240503 14:12:52.427019 13575 raft_consensus.cc:2781] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.427145 13575 raft_consensus.cc:482] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.431000 13575 raft_consensus.cc:3037] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.423595 13375 raft_consensus.cc:2454] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:52.431973 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fec024e5ae7c43ebac0fb6f813701797" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.432196 13525 raft_consensus.cc:3037] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.436007 13525 raft_consensus.cc:2454] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:52.436802 13418 leader_election.cc:302] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.437119 13576 leader_election.cc:288] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.437412 13593 raft_consensus.cc:2781] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.437647 13593 raft_consensus.cc:686] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:52.438241 13593 consensus_queue.cc:237] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.441663 13622 raft_consensus.cc:482] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.442104 13622 raft_consensus.cc:504] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.442952 13622 leader_election.cc:288] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.443708 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.444037 13525 raft_consensus.cc:2454] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.444511 13343 leader_election.cc:302] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.444886 13622 raft_consensus.cc:2781] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.445003 13622 raft_consensus.cc:482] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.445132 13622 raft_consensus.cc:3037] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.445945 13575 raft_consensus.cc:504] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.447497 13575 leader_election.cc:288] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.447552 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.447741 13527 raft_consensus.cc:3037] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.448463 13622 raft_consensus.cc:504] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.449852 13622 leader_election.cc:288] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.450150 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.450402 13526 raft_consensus.cc:3037] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.454552 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.456401 13527 raft_consensus.cc:2454] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.456915 13343 leader_election.cc:302] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.457324 13622 raft_consensus.cc:2781] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.457511 13622 raft_consensus.cc:686] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.457835 13622 consensus_queue.cc:237] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:52.459713 13344 leader_election.cc:341] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.460167 13621 consensus_queue.cc:1035] T ba6a0edf6cd84b4989c9a549936bb5aa P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.463387 13588 consensus_queue.cc:1035] T 325462c18cf14226ac695fcb5f0463c3 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.463464 13576 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.453935 13526 raft_consensus.cc:2454] T 846afe766b12483fb24acc12a1c88d3e P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.464141 13343 leader_election.cc:302] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8
I20240503 14:12:52.465167 13623 raft_consensus.cc:2781] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.465332 13623 raft_consensus.cc:686] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.465647 13623 consensus_queue.cc:237] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.483664 13573 consensus_queue.cc:1035] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.484530 13576 consensus_queue.cc:1035] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.485220 13588 consensus_queue.cc:1035] T b61dac9e02af42bf90fe1c8d9409b022 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.488909 13276 catalog_manager.cc:5484] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.492931 13681 consensus_queue.cc:1035] T d1f84c6ec1d449f591d23ccf8b6d9a0f P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.447361 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8fb295127b54943a2971e2a30a59d74" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
W20240503 14:12:52.514928 13344 leader_election.cc:341] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.519562 13595 raft_consensus.cc:482] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.519905 13595 raft_consensus.cc:504] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.521381 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.521736 13595 leader_election.cc:288] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.522068 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee5723bf5c86432d9320810b098874f2" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.522112 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "846afe766b12483fb24acc12a1c88d3e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:52.522634 13344 leader_election.cc:341] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.523298 13573 consensus_queue.cc:1035] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.525125 13376 raft_consensus.cc:2379] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 16559a1767cd4197b59673a1a99035a8 in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:52.525830 13419 leader_election.cc:302] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:52.526471 13595 raft_consensus.cc:3037] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.529767 13595 raft_consensus.cc:2726] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.541942 13749 consensus_queue.cc:1035] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.542009 13588 consensus_queue.cc:1035] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:52.544909 13576 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.556058 13276 catalog_manager.cc:5484] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.562575 13696 consensus_queue.cc:1035] T 44014ff0028742f6a0241f820367cae0 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.574251 13570 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.574518 13570 ts_tablet_manager.cc:1367] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.291s user 0.056s sys 0.102s
I20240503 14:12:52.575551 13570 raft_consensus.cc:348] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.575838 13570 raft_consensus.cc:374] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.575942 13570 raft_consensus.cc:729] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.576258 13570 consensus_queue.cc:260] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.576908 13570 ts_tablet_manager.cc:1398] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.577266 13570 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.579094 13570 tablet_bootstrap.cc:654] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.580169 13276 catalog_manager.cc:5484] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.585562 13570 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.585817 13570 ts_tablet_manager.cc:1367] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20240503 14:12:52.589669 13570 raft_consensus.cc:348] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.590039 13570 raft_consensus.cc:374] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.592463 13570 raft_consensus.cc:729] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.592856 13570 consensus_queue.cc:260] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.594429 13570 ts_tablet_manager.cc:1398] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.008s user 0.003s sys 0.001s
I20240503 14:12:52.595467 13570 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.598803 13570 tablet_bootstrap.cc:654] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.605540 13570 tablet_bootstrap.cc:492] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.605798 13570 ts_tablet_manager.cc:1367] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20240503 14:12:52.606832 13570 raft_consensus.cc:348] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.607117 13570 raft_consensus.cc:374] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.607219 13570 raft_consensus.cc:729] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.607476 13570 consensus_queue.cc:260] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.608644 13696 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.609781 13569 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.609826 13570 ts_tablet_manager.cc:1398] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:12:52.609997 13569 ts_tablet_manager.cc:1367] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.250s user 0.089s sys 0.089s
I20240503 14:12:52.610872 13569 raft_consensus.cc:348] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.611116 13569 raft_consensus.cc:374] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.611207 13569 raft_consensus.cc:729] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.611433 13569 consensus_queue.cc:260] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.612152 13569 ts_tablet_manager.cc:1398] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.612481 13569 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.613921 13568 tablet_bootstrap.cc:492] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.614146 13568 ts_tablet_manager.cc:1367] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.252s user 0.046s sys 0.104s
I20240503 14:12:52.614235 13569 tablet_bootstrap.cc:654] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.614413 13570 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.614969 13568 raft_consensus.cc:348] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.615202 13568 raft_consensus.cc:374] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.615332 13568 raft_consensus.cc:729] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.615563 13568 consensus_queue.cc:260] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.615993 13570 tablet_bootstrap.cc:654] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.616158 13568 ts_tablet_manager.cc:1398] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:52.616295 13749 raft_consensus.cc:482] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.617249 13749 raft_consensus.cc:504] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.618474 13749 leader_election.cc:288] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.619925 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.620173 13452 raft_consensus.cc:2454] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.620029 13276 catalog_manager.cc:5484] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.620473 13569 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.620644 13568 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.620677 13569 ts_tablet_manager.cc:1367] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20240503 14:12:52.620766 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.621253 13749 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.621500 13569 raft_consensus.cc:348] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:52.622262 13493 leader_election.cc:341] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.622512 13493 leader_election.cc:302] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.622313 13276 catalog_manager.cc:5484] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.623019 13568 tablet_bootstrap.cc:654] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.623433 13569 raft_consensus.cc:374] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.623678 13569 raft_consensus.cc:729] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.624791 13569 consensus_queue.cc:260] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.625646 13749 raft_consensus.cc:2781] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.627671 13749 raft_consensus.cc:482] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.627838 13749 raft_consensus.cc:3037] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.631469 13569 ts_tablet_manager.cc:1398] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20240503 14:12:52.632257 13569 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.634370 13595 consensus_queue.cc:1035] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.636914 13749 raft_consensus.cc:504] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.638571 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.639636 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.640144 13450 raft_consensus.cc:3037] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.643507 13450 raft_consensus.cc:2454] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.644354 13493 leader_election.cc:302] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.639915 13749 leader_election.cc:288] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.646157 13696 raft_consensus.cc:2781] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.646355 13696 raft_consensus.cc:686] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.646951 13696 consensus_queue.cc:237] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:52.648388 13493 leader_election.cc:341] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.653097 13569 tablet_bootstrap.cc:654] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.654206 13570 tablet_bootstrap.cc:492] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.654441 13570 ts_tablet_manager.cc:1367] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.040s user 0.015s sys 0.007s
I20240503 14:12:52.656351 13570 raft_consensus.cc:348] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.656662 13570 raft_consensus.cc:374] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.656756 13570 raft_consensus.cc:729] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.657076 13570 consensus_queue.cc:260] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.657840 13570 ts_tablet_manager.cc:1398] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:52.663928 13570 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.664011 13276 catalog_manager.cc:5484] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.665817 13570 tablet_bootstrap.cc:654] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.673491 13681 consensus_queue.cc:1035] T e7bd97becb1b48589913cf52da1ab41d P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.681162 13569 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.681207 13568 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.681380 13568 ts_tablet_manager.cc:1367] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.065s user 0.008s sys 0.024s
I20240503 14:12:52.681380 13569 ts_tablet_manager.cc:1367] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.050s user 0.007s sys 0.014s
I20240503 14:12:52.682091 13568 raft_consensus.cc:348] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.682269 13568 raft_consensus.cc:374] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.682262 13569 raft_consensus.cc:348] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.682415 13568 raft_consensus.cc:729] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.682484 13569 raft_consensus.cc:374] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.682533 13569 raft_consensus.cc:729] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.682729 13568 consensus_queue.cc:260] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.682754 13569 consensus_queue.cc:260] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.683316 13569 ts_tablet_manager.cc:1398] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.683800 13569 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.684110 13576 consensus_queue.cc:1035] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.686381 13569 tablet_bootstrap.cc:654] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.690826 13621 consensus_queue.cc:1035] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.683315 13568 ts_tablet_manager.cc:1398] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.693321 13568 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.695111 13570 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.695264 13570 ts_tablet_manager.cc:1367] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.000s
I20240503 14:12:52.695811 13569 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.695958 13569 ts_tablet_manager.cc:1367] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s
I20240503 14:12:52.696017 13570 raft_consensus.cc:348] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.696202 13570 raft_consensus.cc:374] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.696254 13570 raft_consensus.cc:729] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.696471 13570 consensus_queue.cc:260] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.696642 13569 raft_consensus.cc:348] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.696780 13569 raft_consensus.cc:374] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.696838 13569 raft_consensus.cc:729] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.696980 13570 ts_tablet_manager.cc:1398] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:52.697077 13569 consensus_queue.cc:260] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.697208 13568 tablet_bootstrap.cc:654] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.697227 13570 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.697616 13569 ts_tablet_manager.cc:1398] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.697870 13569 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.698771 13570 tablet_bootstrap.cc:654] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.699105 13569 tablet_bootstrap.cc:654] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.700886 13576 consensus_queue.cc:1035] T bcefb8b7ac4f4a9cad6b9fa6cc81f73c P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.707445 13569 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.707445 13568 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.707643 13568 ts_tablet_manager.cc:1367] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s
I20240503 14:12:52.708220 13570 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.708338 13570 ts_tablet_manager.cc:1367] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s
I20240503 14:12:52.708436 13568 raft_consensus.cc:348] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.708629 13568 raft_consensus.cc:374] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.708678 13568 raft_consensus.cc:729] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.708866 13568 consensus_queue.cc:260] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.707643 13569 ts_tablet_manager.cc:1367] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20240503 14:12:52.709051 13570 raft_consensus.cc:348] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.709194 13570 raft_consensus.cc:374] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.709241 13570 raft_consensus.cc:729] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.709430 13570 consensus_queue.cc:260] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.709722 13569 raft_consensus.cc:348] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.709885 13569 raft_consensus.cc:374] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.709944 13569 raft_consensus.cc:729] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.709997 13570 ts_tablet_manager.cc:1398] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.710247 13570 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.710156 13569 consensus_queue.cc:260] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.710664 13569 ts_tablet_manager.cc:1398] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:52.710917 13569 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.711757 13570 tablet_bootstrap.cc:654] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.712179 13569 tablet_bootstrap.cc:654] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.714051 13568 ts_tablet_manager.cc:1398] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20240503 14:12:52.714397 13568 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.714617 13623 consensus_queue.cc:1035] T de013d0b1c964223939e190d1ada54cd P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.716300 13568 tablet_bootstrap.cc:654] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.719269 13569 tablet_bootstrap.cc:492] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.719270 13570 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.719458 13569 ts_tablet_manager.cc:1367] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20240503 14:12:52.719488 13570 ts_tablet_manager.cc:1367] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20240503 14:12:52.720183 13569 raft_consensus.cc:348] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.720372 13569 raft_consensus.cc:374] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.720427 13569 raft_consensus.cc:729] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.720212 13570 raft_consensus.cc:348] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.720647 13569 consensus_queue.cc:260] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.721165 13570 raft_consensus.cc:374] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.721231 13570 raft_consensus.cc:729] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.721462 13570 consensus_queue.cc:260] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.721592 13569 ts_tablet_manager.cc:1398] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.721877 13569 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.722191 13570 ts_tablet_manager.cc:1398] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:52.722486 13570 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.724431 13569 tablet_bootstrap.cc:654] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.724694 13570 tablet_bootstrap.cc:654] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.731900 13696 raft_consensus.cc:482] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.732127 13696 raft_consensus.cc:504] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.732861 13696 leader_election.cc:288] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.733819 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff759f510546409387dfd2383ec352" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.734071 13570 tablet_bootstrap.cc:492] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.734205 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff759f510546409387dfd2383ec352" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.734385 13450 raft_consensus.cc:2454] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.734777 13493 leader_election.cc:302] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.734091 13377 raft_consensus.cc:2454] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.735435 13569 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.735555 13569 ts_tablet_manager.cc:1367] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.006s
I20240503 14:12:52.735579 13696 raft_consensus.cc:2781] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.735639 13696 raft_consensus.cc:482] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.735692 13696 raft_consensus.cc:3037] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.736331 13569 raft_consensus.cc:348] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.736495 13569 raft_consensus.cc:374] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.736542 13569 raft_consensus.cc:729] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.736555 13593 consensus_queue.cc:1035] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.736758 13569 consensus_queue.cc:260] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.737385 13569 ts_tablet_manager.cc:1398] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.737653 13569 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.738752 13696 raft_consensus.cc:504] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.739657 13569 tablet_bootstrap.cc:654] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.739917 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff759f510546409387dfd2383ec352" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.740109 13379 raft_consensus.cc:3037] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.740456 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96ff759f510546409387dfd2383ec352" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.740607 13450 raft_consensus.cc:3037] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.742985 13379 raft_consensus.cc:2454] T 96ff759f510546409387dfd2383ec352 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.743198 13623 raft_consensus.cc:482] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.743425 13696 leader_election.cc:288] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.743369 13623 raft_consensus.cc:504] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.743018 13450 raft_consensus.cc:2454] T 96ff759f510546409387dfd2383ec352 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.734258 13570 ts_tablet_manager.cc:1367] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.000s
I20240503 14:12:52.744882 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78128a31c0c4c888cf6c49d6c39c205" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:52.745136 13528 raft_consensus.cc:2454] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.745154 13570 raft_consensus.cc:348] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.745503 13570 raft_consensus.cc:374] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.745599 13570 raft_consensus.cc:729] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.743548 13493 leader_election.cc:302] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.745949 13570 consensus_queue.cc:260] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.746490 13343 leader_election.cc:302] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.746850 13622 raft_consensus.cc:2781] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.746930 13622 raft_consensus.cc:482] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.747002 13622 raft_consensus.cc:3037] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.744182 13623 leader_election.cc:288] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.750396 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78128a31c0c4c888cf6c49d6c39c205" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.750679 13450 raft_consensus.cc:2454] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.751859 13622 raft_consensus.cc:504] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.753101 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78128a31c0c4c888cf6c49d6c39c205" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.753348 13450 raft_consensus.cc:3037] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.755131 13570 ts_tablet_manager.cc:1398] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20240503 14:12:52.755347 13749 raft_consensus.cc:2781] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.755504 13749 raft_consensus.cc:686] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.755805 13570 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.755748 13749 consensus_queue.cc:237] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.757009 13588 consensus_queue.cc:1035] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.758188 13570 tablet_bootstrap.cc:654] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.758653 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a78128a31c0c4c888cf6c49d6c39c205" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.758831 13528 raft_consensus.cc:3037] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.762147 13622 leader_election.cc:288] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.761914 13528 raft_consensus.cc:2454] T a78128a31c0c4c888cf6c49d6c39c205 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.762624 13343 leader_election.cc:302] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.763049 13622 raft_consensus.cc:2781] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.763180 13622 raft_consensus.cc:686] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.763347 13588 consensus_queue.cc:1035] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.763427 13622 consensus_queue.cc:237] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.765107 13450 raft_consensus.cc:2454] T a78128a31c0c4c888cf6c49d6c39c205 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.788596 13568 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.788895 13568 ts_tablet_manager.cc:1367] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.075s user 0.023s sys 0.020s
I20240503 14:12:52.789801 13568 raft_consensus.cc:348] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.791429 13568 raft_consensus.cc:374] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.791610 13568 raft_consensus.cc:729] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.791965 13568 consensus_queue.cc:260] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.792174 13277 catalog_manager.cc:5484] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:52.792721 13568 ts_tablet_manager.cc:1398] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240503 14:12:52.791322 13570 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.793140 13570 ts_tablet_manager.cc:1367] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20240503 14:12:52.793923 13570 raft_consensus.cc:348] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.794219 13570 raft_consensus.cc:374] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.794275 13570 raft_consensus.cc:729] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.794525 13570 consensus_queue.cc:260] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.795259 13570 ts_tablet_manager.cc:1398] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.795616 13570 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.797544 13570 tablet_bootstrap.cc:654] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.798928 13568 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.800760 13568 tablet_bootstrap.cc:654] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.806468 13570 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.806680 13570 ts_tablet_manager.cc:1367] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.003s
I20240503 14:12:52.806630 13595 consensus_queue.cc:1035] T a85fc6b00d9f4d6e8143448310037622 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.807392 13570 raft_consensus.cc:348] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.807611 13570 raft_consensus.cc:374] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.807672 13570 raft_consensus.cc:729] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.807896 13570 consensus_queue.cc:260] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.808552 13570 ts_tablet_manager.cc:1398] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.808923 13570 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.810262 13681 raft_consensus.cc:482] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.811025 13681 raft_consensus.cc:504] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.811354 13570 tablet_bootstrap.cc:654] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.811703 13681 leader_election.cc:288] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.812541 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:52.813148 13419 leader_election.cc:341] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.813370 13568 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.813529 13568 ts_tablet_manager.cc:1367] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.004s
I20240503 14:12:52.813824 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:52.814384 13418 leader_election.cc:341] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.814332 13568 raft_consensus.cc:348] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.814529 13568 raft_consensus.cc:374] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.814499 13418 leader_election.cc:302] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:52.814803 13595 raft_consensus.cc:2726] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.814913 13568 raft_consensus.cc:729] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.815210 13568 consensus_queue.cc:260] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.815968 13568 ts_tablet_manager.cc:1398] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.818279 13277 catalog_manager.cc:5484] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.819828 13568 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.819788 13749 raft_consensus.cc:482] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.820046 13749 raft_consensus.cc:504] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.820228 13569 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.820360 13569 ts_tablet_manager.cc:1367] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.083s user 0.030s sys 0.039s
I20240503 14:12:52.820699 13749 leader_election.cc:288] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.821106 13569 raft_consensus.cc:348] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.821280 13569 raft_consensus.cc:374] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.821329 13569 raft_consensus.cc:729] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.821535 13569 consensus_queue.cc:260] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.822080 13569 ts_tablet_manager.cc:1398] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.822393 13569 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.823065 13568 tablet_bootstrap.cc:654] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.823607 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.824108 13569 tablet_bootstrap.cc:654] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
W20240503 14:12:52.824191 13493 leader_election.cc:341] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.824822 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.826406 13570 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.826589 13570 ts_tablet_manager.cc:1367] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240503 14:12:52.827443 13570 raft_consensus.cc:348] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.827653 13570 raft_consensus.cc:374] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.827709 13570 raft_consensus.cc:729] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.827919 13570 consensus_queue.cc:260] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.828608 13570 ts_tablet_manager.cc:1398] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:52.828986 13570 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
W20240503 14:12:52.829727 13493 leader_election.cc:341] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.829857 13493 leader_election.cc:302] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.830376 13749 raft_consensus.cc:2726] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:52.835237 13569 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:52.835237 13568 tablet_bootstrap.cc:492] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:52.835407 13569 ts_tablet_manager.cc:1367] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20240503 14:12:52.835422 13568 ts_tablet_manager.cc:1367] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20240503 14:12:52.835508 13570 tablet_bootstrap.cc:654] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.836103 13569 raft_consensus.cc:348] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.836280 13569 raft_consensus.cc:374] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.836213 13568 raft_consensus.cc:348] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.836336 13569 raft_consensus.cc:729] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.836380 13568 raft_consensus.cc:374] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.836452 13568 raft_consensus.cc:729] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.836573 13569 consensus_queue.cc:260] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.836724 13568 consensus_queue.cc:260] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.837206 13569 ts_tablet_manager.cc:1398] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:52.837203 13568 ts_tablet_manager.cc:1398] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:52.837505 13568 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:52.837560 13569 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:52.839293 13568 tablet_bootstrap.cc:654] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.839354 13569 tablet_bootstrap.cc:654] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.840207 13622 raft_consensus.cc:482] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.840368 13622 raft_consensus.cc:504] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.841171 13622 leader_election.cc:288] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.841938 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.842200 13453 raft_consensus.cc:2454] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.842804 13344 leader_election.cc:302] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.843581 13570 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.843819 13570 ts_tablet_manager.cc:1367] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.002s
I20240503 14:12:52.843906 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:52.844820 13343 leader_election.cc:341] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.845435 13622 raft_consensus.cc:2781] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.845546 13622 raft_consensus.cc:482] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.845613 13622 raft_consensus.cc:3037] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.847497 13570 raft_consensus.cc:348] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.847925 13570 raft_consensus.cc:374] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.848037 13570 raft_consensus.cc:729] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.848374 13570 consensus_queue.cc:260] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.849100 13570 ts_tablet_manager.cc:1398] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20240503 14:12:52.849737 13622 raft_consensus.cc:504] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.851080 13570 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.851771 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.851955 13453 raft_consensus.cc:3037] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.853399 13570 tablet_bootstrap.cc:654] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.857631 13453 raft_consensus.cc:2454] T fa59a1a71e92475eb287f0cdf7558884 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.860905 13344 leader_election.cc:302] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.861302 13655 raft_consensus.cc:2781] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.861426 13655 raft_consensus.cc:686] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.861747 13655 consensus_queue.cc:237] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.864481 13452 raft_consensus.cc:3037] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.865171 13570 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.865345 13622 leader_election.cc:288] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.865520 13570 ts_tablet_manager.cc:1367] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.010s
I20240503 14:12:52.866649 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
W20240503 14:12:52.867255 13343 leader_election.cc:341] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.867323 13570 raft_consensus.cc:348] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.867712 13570 raft_consensus.cc:374] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.867815 13570 raft_consensus.cc:729] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.868126 13570 consensus_queue.cc:260] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.870437 13622 consensus_queue.cc:1035] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.872730 13570 ts_tablet_manager.cc:1398] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20240503 14:12:52.873226 13570 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.875272 13570 tablet_bootstrap.cc:654] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.875123 13275 catalog_manager.cc:5484] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:52.884728 13570 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.885051 13570 ts_tablet_manager.cc:1367] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20240503 14:12:52.888347 13570 raft_consensus.cc:348] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.889514 13623 consensus_queue.cc:1035] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.890187 13570 raft_consensus.cc:374] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.890373 13570 raft_consensus.cc:729] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.890702 13570 consensus_queue.cc:260] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.891671 13570 ts_tablet_manager.cc:1398] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 14:12:52.892525 13570 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:52.897439 13570 tablet_bootstrap.cc:654] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.898157 13749 consensus_queue.cc:1035] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.906436 13570 tablet_bootstrap.cc:492] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:52.906795 13570 ts_tablet_manager.cc:1367] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20240503 14:12:52.907790 13570 raft_consensus.cc:348] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.908109 13623 raft_consensus.cc:482] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.908207 13570 raft_consensus.cc:374] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:52.908386 13570 raft_consensus.cc:729] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:52.908308 13623 raft_consensus.cc:504] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.909123 13623 leader_election.cc:288] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.910086 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b84c7de40447b8d01baa8385c7817" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:52.910845 13343 leader_election.cc:341] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.911826 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b84c7de40447b8d01baa8385c7817" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.912074 13453 raft_consensus.cc:2454] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:52.913408 13344 leader_election.cc:302] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters: 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:52.914196 13575 raft_consensus.cc:2781] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.914291 13575 raft_consensus.cc:482] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.914353 13575 raft_consensus.cc:3037] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.914378 13377 raft_consensus.cc:3037] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.917944 13575 raft_consensus.cc:504] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.919185 13576 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:52.922788 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b84c7de40447b8d01baa8385c7817" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.923058 13453 raft_consensus.cc:3037] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.927034 13453 raft_consensus.cc:2454] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:52.927377 13749 raft_consensus.cc:482] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.927559 13749 raft_consensus.cc:504] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.928226 13749 leader_election.cc:288] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.929085 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.929103 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.929364 13451 raft_consensus.cc:2454] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
W20240503 14:12:52.929654 13493 leader_election.cc:341] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.929852 13493 leader_election.cc:302] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.930685 13749 raft_consensus.cc:2781] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.930790 13749 raft_consensus.cc:482] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.930853 13749 raft_consensus.cc:3037] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.935967 13593 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.939023 13344 leader_election.cc:302] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:52.939249 13377 raft_consensus.cc:3037] T 82d492b984954755969aedb2c1bf7eda P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.939757 13749 raft_consensus.cc:504] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.941149 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:52.941879 13493 leader_election.cc:341] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.942494 13575 leader_election.cc:288] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:52.942705 13575 raft_consensus.cc:2781] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.942909 13575 raft_consensus.cc:686] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:52.943392 13627 consensus_queue.cc:1035] T 82d492b984954755969aedb2c1bf7eda P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.942668 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b04c12317b434827849e93569eb4e50c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.943233 13696 raft_consensus.cc:482] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.943590 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e32b84c7de40447b8d01baa8385c7817" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:52.943754 13696 raft_consensus.cc:504] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:52.944329 13343 leader_election.cc:341] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.944411 13696 leader_election.cc:288] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.944736 13453 raft_consensus.cc:3037] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.943113 13749 leader_election.cc:288] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.943495 13575 consensus_queue.cc:237] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.946058 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:52.952214 13493 leader_election.cc:341] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:52.952304 13570 consensus_queue.cc:260] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.954665 13749 raft_consensus.cc:482] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.954926 13749 raft_consensus.cc:504] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.948315 13453 raft_consensus.cc:2454] T b04c12317b434827849e93569eb4e50c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.956403 13493 leader_election.cc:302] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:52.956459 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dfb820527284be694af068e5c804906" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:52.956718 13375 raft_consensus.cc:2454] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.956997 13696 raft_consensus.cc:2781] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.957151 13696 raft_consensus.cc:686] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.957321 13493 leader_election.cc:302] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.957682 13588 raft_consensus.cc:2781] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:52.957564 13696 consensus_queue.cc:237] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.957778 13588 raft_consensus.cc:482] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:52.957883 13588 raft_consensus.cc:3037] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.957991 13749 leader_election.cc:288] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.959221 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dfb820527284be694af068e5c804906" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:52.959507 13451 raft_consensus.cc:2454] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:52.961213 13588 raft_consensus.cc:504] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.962121 13588 leader_election.cc:288] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.962687 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dfb820527284be694af068e5c804906" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:52.962958 13451 raft_consensus.cc:3037] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.966648 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1dfb820527284be694af068e5c804906" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:52.966944 13375 raft_consensus.cc:3037] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.971215 13451 raft_consensus.cc:2454] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.972438 13493 leader_election.cc:302] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:52.972846 13451 raft_consensus.cc:3037] T 846afe766b12483fb24acc12a1c88d3e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:52.972955 13627 raft_consensus.cc:2781] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:52.973129 13627 raft_consensus.cc:686] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:52.973450 13627 consensus_queue.cc:237] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.981134 13623 consensus_queue.cc:1035] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.981799 13623 consensus_queue.cc:1035] T 846afe766b12483fb24acc12a1c88d3e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:52.983927 13375 raft_consensus.cc:2454] T 1dfb820527284be694af068e5c804906 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:52.992058 13749 raft_consensus.cc:482] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:52.992424 13749 raft_consensus.cc:504] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:52.993265 13749 leader_election.cc:288] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:52.955659 13570 ts_tablet_manager.cc:1398] T 1dfb820527284be694af068e5c804906 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.049s user 0.002s sys 0.000s
I20240503 14:12:52.997876 13570 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.000293 13570 tablet_bootstrap.cc:654] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:52.945179 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.007159 13595 raft_consensus.cc:482] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.007477 13595 raft_consensus.cc:504] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.008533 13595 leader_election.cc:288] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.009418 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.009562 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.010246 13418 leader_election.cc:341] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.010495 13419 leader_election.cc:341] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.010684 13419 leader_election.cc:302] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.011005 13595 raft_consensus.cc:2726] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.012959 13568 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.013208 13568 ts_tablet_manager.cc:1367] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.176s user 0.038s sys 0.061s
I20240503 14:12:53.014523 13568 raft_consensus.cc:348] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.014868 13568 raft_consensus.cc:374] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.014994 13568 raft_consensus.cc:729] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.015362 13568 consensus_queue.cc:260] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.016219 13595 raft_consensus.cc:482] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.016474 13595 raft_consensus.cc:504] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.017441 13595 leader_election.cc:288] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.018049 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.018765 13419 leader_election.cc:341] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.018999 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:53.019433 13418 leader_election.cc:341] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.019547 13418 leader_election.cc:302] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.019802 13595 raft_consensus.cc:2726] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.020743 13568 ts_tablet_manager.cc:1398] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20240503 14:12:53.021359 13568 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.022819 13276 catalog_manager.cc:5484] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.023291 13569 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.023533 13569 ts_tablet_manager.cc:1367] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.186s user 0.080s sys 0.097s
I20240503 14:12:53.024480 13568 tablet_bootstrap.cc:654] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.025125 13569 raft_consensus.cc:348] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.025435 13569 raft_consensus.cc:374] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.025537 13569 raft_consensus.cc:729] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.032644 13570 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.032980 13570 ts_tablet_manager.cc:1367] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.000s
I20240503 14:12:53.034063 13570 raft_consensus.cc:348] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.034427 13570 raft_consensus.cc:374] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.034587 13570 raft_consensus.cc:729] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.034929 13570 consensus_queue.cc:260] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:53.034606 13493 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.12.1.129:38667, user_credentials={real_user=slave}} blocked reactor thread for 59872.1us
I20240503 14:12:53.026597 13569 consensus_queue.cc:260] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.036183 13569 ts_tablet_manager.cc:1398] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20240503 14:12:53.036617 13569 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.037434 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.038154 13570 ts_tablet_manager.cc:1398] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240503 14:12:53.039889 13570 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
W20240503 14:12:53.041911 13493 leader_election.cc:341] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.042097 13493 leader_election.cc:302] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.039466 13569 tablet_bootstrap.cc:654] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.042861 13818 raft_consensus.cc:2726] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.044782 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.045130 13450 raft_consensus.cc:2454] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.046027 13570 tablet_bootstrap.cc:654] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.046341 13277 catalog_manager.cc:5484] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.047050 13277 catalog_manager.cc:5484] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.051717 13569 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.051997 13569 ts_tablet_manager.cc:1367] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20240503 14:12:53.052052 13570 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.052413 13570 ts_tablet_manager.cc:1367] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s
I20240503 14:12:53.054405 13570 raft_consensus.cc:348] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.054917 13570 raft_consensus.cc:374] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.055030 13570 raft_consensus.cc:729] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.055413 13570 consensus_queue.cc:260] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.056517 13569 raft_consensus.cc:348] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.057242 13569 raft_consensus.cc:374] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.058539 13570 ts_tablet_manager.cc:1398] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20240503 14:12:53.059603 13569 raft_consensus.cc:729] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.059957 13570 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.059973 13569 consensus_queue.cc:260] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.061892 13569 ts_tablet_manager.cc:1398] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20240503 14:12:53.062146 13570 tablet_bootstrap.cc:654] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.062289 13569 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.064297 13568 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.065335 13568 ts_tablet_manager.cc:1367] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.043s user 0.014s sys 0.006s
I20240503 14:12:53.065882 13569 tablet_bootstrap.cc:654] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.066378 13568 raft_consensus.cc:348] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.066740 13568 raft_consensus.cc:374] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.066917 13568 raft_consensus.cc:729] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.067128 13593 raft_consensus.cc:482] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.067351 13593 raft_consensus.cc:504] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.059773 13493 leader_election.cc:302] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.068112 13593 leader_election.cc:288] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.068423 13818 raft_consensus.cc:2781] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.068485 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.068571 13818 raft_consensus.cc:482] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.068668 13818 raft_consensus.cc:3037] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.068930 13568 consensus_queue.cc:260] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:53.069100 13419 leader_election.cc:341] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.069741 13568 ts_tablet_manager.cc:1398] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:53.070426 13568 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.072120 13818 raft_consensus.cc:504] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.072911 13818 leader_election.cc:288] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.073433 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.073729 13528 raft_consensus.cc:2454] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.074236 13568 tablet_bootstrap.cc:654] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.074482 13418 leader_election.cc:302] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.075076 13593 raft_consensus.cc:2781] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.075214 13593 raft_consensus.cc:482] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.075361 13593 raft_consensus.cc:3037] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
W20240503 14:12:53.077585 13493 leader_election.cc:341] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.078411 13593 raft_consensus.cc:504] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.079423 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:53.079948 13419 leader_election.cc:341] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.080595 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.080819 13450 raft_consensus.cc:3037] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.081005 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.082787 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.083040 13528 raft_consensus.cc:3037] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.084424 13450 raft_consensus.cc:2454] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
W20240503 14:12:53.085229 13493 leader_election.cc:341] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.085508 13588 consensus_queue.cc:1035] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.086802 13749 consensus_queue.cc:1035] T 3d1f8fbaaef34325ab780e134bcd9d6b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.087339 13528 raft_consensus.cc:2454] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.087476 13493 leader_election.cc:302] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.087869 13418 leader_election.cc:302] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.088191 13595 raft_consensus.cc:482] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.088362 13595 raft_consensus.cc:504] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.089118 13595 leader_election.cc:288] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.089325 13595 raft_consensus.cc:2781] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.089497 13595 raft_consensus.cc:686] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:53.090224 13588 raft_consensus.cc:2781] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.090278 13570 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.090402 13588 raft_consensus.cc:686] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.090654 13570 ts_tablet_manager.cc:1367] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.009s
I20240503 14:12:53.090780 13588 consensus_queue.cc:237] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.091691 13570 raft_consensus.cc:348] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.092059 13570 raft_consensus.cc:374] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.092204 13570 raft_consensus.cc:729] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.092532 13570 consensus_queue.cc:260] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.092703 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.092970 13377 raft_consensus.cc:2454] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.093490 13570 ts_tablet_manager.cc:1398] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:53.093998 13570 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.094432 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.094738 13526 raft_consensus.cc:2454] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.096259 13570 tablet_bootstrap.cc:654] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.096443 13419 leader_election.cc:302] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.097143 13576 raft_consensus.cc:2781] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.097285 13576 raft_consensus.cc:482] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.097373 13576 raft_consensus.cc:3037] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.089809 13595 consensus_queue.cc:237] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.100557 13576 raft_consensus.cc:504] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.102459 13576 leader_election.cc:288] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.107226 13593 leader_election.cc:288] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.109030 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.109586 13528 raft_consensus.cc:3037] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.112804 13528 raft_consensus.cc:2454] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.113384 13418 leader_election.cc:302] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.114661 13593 raft_consensus.cc:2781] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.114990 13593 raft_consensus.cc:686] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:53.115286 13593 consensus_queue.cc:237] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.117750 13569 tablet_bootstrap.cc:492] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.117967 13569 ts_tablet_manager.cc:1367] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.056s user 0.018s sys 0.035s
I20240503 14:12:53.118387 13570 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.118840 13570 ts_tablet_manager.cc:1367] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.006s
I20240503 14:12:53.118938 13569 raft_consensus.cc:348] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.119994 13570 raft_consensus.cc:348] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.121590 13570 raft_consensus.cc:374] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.121791 13570 raft_consensus.cc:729] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.122527 13621 raft_consensus.cc:482] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.122632 13621 raft_consensus.cc:504] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.123216 13621 leader_election.cc:288] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.125077 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.125272 13453 raft_consensus.cc:2454] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.125775 13344 leader_election.cc:302] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.126066 13575 raft_consensus.cc:2781] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.126130 13575 raft_consensus.cc:482] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.126215 13575 raft_consensus.cc:3037] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.128880 13575 raft_consensus.cc:504] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.129482 13575 leader_election.cc:288] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.130059 13277 catalog_manager.cc:5484] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.130479 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.130609 13569 raft_consensus.cc:374] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.130650 13453 raft_consensus.cc:3037] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.130669 13569 raft_consensus.cc:729] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.130842 13569 consensus_queue.cc:260] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.131358 13569 ts_tablet_manager.cc:1398] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20240503 14:12:53.131616 13569 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.132922 13569 tablet_bootstrap.cc:654] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.133872 13453 raft_consensus.cc:2454] T 7d44249041c74ca48414ad2c6ca44ff8 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.135064 13569 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.135033 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19240561f76443c4b24b30ead79fc478" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.135183 13569 ts_tablet_manager.cc:1367] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:12:53.135212 13375 raft_consensus.cc:3037] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.134914 13274 catalog_manager.cc:5484] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.135836 13569 raft_consensus.cc:348] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.135999 13569 raft_consensus.cc:374] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.136039 13569 raft_consensus.cc:729] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.136221 13569 consensus_queue.cc:260] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.136847 13569 ts_tablet_manager.cc:1398] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.137110 13569 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.137290 13277 catalog_manager.cc:5484] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.137884 13375 raft_consensus.cc:2454] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.138481 13569 tablet_bootstrap.cc:654] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.141893 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.142164 13528 raft_consensus.cc:2454] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.142630 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d44249041c74ca48414ad2c6ca44ff8" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.142720 13344 leader_election.cc:302] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.142798 13528 raft_consensus.cc:3037] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.143159 13575 raft_consensus.cc:2781] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.143322 13575 raft_consensus.cc:686] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:53.143756 13575 consensus_queue.cc:237] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.145732 13528 raft_consensus.cc:2454] T 7d44249041c74ca48414ad2c6ca44ff8 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.147925 13569 tablet_bootstrap.cc:492] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.148087 13569 ts_tablet_manager.cc:1367] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.006s
I20240503 14:12:53.148880 13569 raft_consensus.cc:348] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.149089 13569 raft_consensus.cc:374] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.149145 13569 raft_consensus.cc:729] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.149377 13569 consensus_queue.cc:260] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.149444 13276 catalog_manager.cc:5484] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.149906 13569 ts_tablet_manager.cc:1398] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.150305 13569 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.151715 13569 tablet_bootstrap.cc:654] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.122323 13570 consensus_queue.cc:260] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.154189 13570 ts_tablet_manager.cc:1398] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20240503 14:12:53.154448 13568 tablet_bootstrap.cc:492] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.154523 13570 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.154589 13568 ts_tablet_manager.cc:1367] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.084s user 0.008s sys 0.010s
I20240503 14:12:53.155319 13568 raft_consensus.cc:348] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.155529 13568 raft_consensus.cc:374] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.155596 13568 raft_consensus.cc:729] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.155787 13568 consensus_queue.cc:260] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.156278 13568 ts_tablet_manager.cc:1398] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:53.156548 13568 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.158339 13568 tablet_bootstrap.cc:654] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.159740 13570 tablet_bootstrap.cc:654] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.161433 13568 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.161571 13568 ts_tablet_manager.cc:1367] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240503 14:12:53.162240 13568 raft_consensus.cc:348] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.162444 13568 raft_consensus.cc:374] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.162511 13568 raft_consensus.cc:729] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.162684 13570 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.162714 13569 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.162806 13570 ts_tablet_manager.cc:1367] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20240503 14:12:53.162850 13569 ts_tablet_manager.cc:1367] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20240503 14:12:53.162729 13568 consensus_queue.cc:260] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.163275 13568 ts_tablet_manager.cc:1398] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.163434 13570 raft_consensus.cc:348] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.163470 13569 raft_consensus.cc:348] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.163599 13568 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.163625 13570 raft_consensus.cc:374] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.163657 13569 raft_consensus.cc:374] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.163671 13570 raft_consensus.cc:729] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.163707 13569 raft_consensus.cc:729] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.163874 13569 consensus_queue.cc:260] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.163875 13570 consensus_queue.cc:260] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.164383 13569 ts_tablet_manager.cc:1398] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240503 14:12:53.164397 13570 ts_tablet_manager.cc:1398] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:53.164652 13569 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.165247 13568 tablet_bootstrap.cc:654] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.168252 13569 tablet_bootstrap.cc:654] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.170136 13570 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.170202 13569 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.170289 13568 tablet_bootstrap.cc:492] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.170332 13569 ts_tablet_manager.cc:1367] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20240503 14:12:53.170532 13568 ts_tablet_manager.cc:1367] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20240503 14:12:53.170958 13569 raft_consensus.cc:348] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.171126 13569 raft_consensus.cc:374] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.171165 13569 raft_consensus.cc:729] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.171308 13569 consensus_queue.cc:260] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.171464 13568 raft_consensus.cc:348] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.171751 13570 tablet_bootstrap.cc:654] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.171706 13569 ts_tablet_manager.cc:1398] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 14:12:53.171850 13568 raft_consensus.cc:374] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.171923 13568 raft_consensus.cc:729] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.172152 13568 consensus_queue.cc:260] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.172688 13568 ts_tablet_manager.cc:1398] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:53.173002 13568 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.173012 13569 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.174731 13569 tablet_bootstrap.cc:654] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.174813 13568 tablet_bootstrap.cc:654] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.175518 13570 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.175761 13570 ts_tablet_manager.cc:1367] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20240503 14:12:53.176026 13588 raft_consensus.cc:482] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.176168 13588 raft_consensus.cc:504] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.176885 13588 leader_election.cc:288] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.177531 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.177735 13375 raft_consensus.cc:2454] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.177841 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.178196 13453 raft_consensus.cc:2454] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.178196 13493 leader_election.cc:302] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.178509 13588 raft_consensus.cc:2781] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.178584 13588 raft_consensus.cc:482] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.178642 13588 raft_consensus.cc:3037] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.179747 13570 raft_consensus.cc:348] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.180054 13570 raft_consensus.cc:374] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.180152 13570 raft_consensus.cc:729] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.180498 13570 consensus_queue.cc:260] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.181439 13588 raft_consensus.cc:504] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.182152 13588 leader_election.cc:288] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.182801 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.183001 13453 raft_consensus.cc:3037] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.184481 13569 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.184589 13569 ts_tablet_manager.cc:1367] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.000s
I20240503 14:12:53.185107 13569 raft_consensus.cc:348] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.185232 13569 raft_consensus.cc:374] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.185262 13569 raft_consensus.cc:729] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.185469 13569 consensus_queue.cc:260] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.185935 13569 ts_tablet_manager.cc:1398] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240503 14:12:53.186589 13569 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.186909 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66e224eae0d04ee1a8851dd89a88289b" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.187142 13375 raft_consensus.cc:3037] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.188346 13569 tablet_bootstrap.cc:654] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.190052 13575 consensus_queue.cc:1035] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.190165 13814 raft_consensus.cc:482] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.190281 13814 raft_consensus.cc:504] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.190411 13818 raft_consensus.cc:482] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.190497 13818 raft_consensus.cc:504] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.190907 13814 leader_election.cc:288] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.190958 13818 leader_election.cc:288] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.192217 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae4e983cf2042f7b03491e9dd3c38c9" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.192409 13450 raft_consensus.cc:2454] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.192704 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.192876 13451 raft_consensus.cc:2454] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.193230 13375 raft_consensus.cc:2454] T 66e224eae0d04ee1a8851dd89a88289b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.194016 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae4e983cf2042f7b03491e9dd3c38c9" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.194217 13493 leader_election.cc:302] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.194315 13588 raft_consensus.cc:482] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.194429 13588 raft_consensus.cc:504] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.194543 13818 raft_consensus.cc:2781] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.194660 13493 leader_election.cc:302] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.194932 13493 leader_election.cc:302] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.195046 13588 leader_election.cc:288] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.195210 13588 raft_consensus.cc:2781] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.195266 13588 raft_consensus.cc:482] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.195317 13588 raft_consensus.cc:3037] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.195369 13814 raft_consensus.cc:2781] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.195443 13814 raft_consensus.cc:482] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.195500 13814 raft_consensus.cc:3037] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.194944 13749 consensus_queue.cc:1035] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20240503 14:12:53.199158 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.199422 13451 raft_consensus.cc:2454] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.194665 13818 raft_consensus.cc:686] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.200095 13818 consensus_queue.cc:237] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.198355 13588 raft_consensus.cc:504] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.202198 13588 leader_election.cc:288] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.202431 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.202945 13493 leader_election.cc:341] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.203315 13493 leader_election.cc:302] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.203444 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae4e983cf2042f7b03491e9dd3c38c9" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:53.203598 13493 leader_election.cc:341] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.203893 13493 leader_election.cc:341] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.204502 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae4e983cf2042f7b03491e9dd3c38c9" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.204696 13451 raft_consensus.cc:3037] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.208019 13451 raft_consensus.cc:2454] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.208650 13749 raft_consensus.cc:2781] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.208738 13749 raft_consensus.cc:482] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.208796 13749 raft_consensus.cc:3037] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.211884 13749 raft_consensus.cc:504] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.212824 13749 leader_election.cc:288] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.213994 13814 raft_consensus.cc:504] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.214692 13814 leader_election.cc:288] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.217702 13569 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.217866 13569 ts_tablet_manager.cc:1367] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.003s
I20240503 14:12:53.217947 13655 consensus_queue.cc:1035] T a78128a31c0c4c888cf6c49d6c39c205 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.218645 13655 raft_consensus.cc:482] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.218708 13569 raft_consensus.cc:348] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.218757 13655 raft_consensus.cc:504] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.218863 13569 raft_consensus.cc:374] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.218914 13569 raft_consensus.cc:729] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.219161 13569 consensus_queue.cc:260] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.219321 13655 leader_election.cc:288] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.219710 13569 ts_tablet_manager.cc:1398] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.219924 13452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.220120 13452 raft_consensus.cc:2379] T 3ec3306783ad4c918421e3ae57924197 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:53.220543 13569 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.221159 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ec3306783ad4c918421e3ae57924197" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.222175 13343 leader_election.cc:302] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.222673 13623 raft_consensus.cc:3037] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.223142 13493 leader_election.cc:302] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.223429 13818 raft_consensus.cc:2781] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.223554 13818 raft_consensus.cc:686] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.223785 13818 consensus_queue.cc:237] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.224073 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.224212 13454 raft_consensus.cc:3037] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.224450 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.224617 13450 raft_consensus.cc:3037] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.225203 13623 raft_consensus.cc:2726] T 3ec3306783ad4c918421e3ae57924197 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.225822 13379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.225827 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:53.226780 13493 leader_election.cc:341] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.226984 13493 leader_election.cc:341] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.227205 13454 raft_consensus.cc:2454] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.227720 13450 raft_consensus.cc:2454] T 7b94535bb3734538b0c8850f2b24eaf5 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.193418 13453 raft_consensus.cc:2454] T 66e224eae0d04ee1a8851dd89a88289b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.193635 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.229055 13493 leader_election.cc:302] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.229310 13573 consensus_queue.cc:1035] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.229714 13573 raft_consensus.cc:2781] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.229826 13573 raft_consensus.cc:686] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.230068 13573 consensus_queue.cc:237] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.231797 13570 ts_tablet_manager.cc:1398] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20240503 14:12:53.232172 13570 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.232205 13493 leader_election.cc:302] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
W20240503 14:12:53.233825 13493 leader_election.cc:341] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.234289 13814 raft_consensus.cc:2781] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.234668 13814 raft_consensus.cc:686] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.234910 13814 consensus_queue.cc:237] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.236920 13570 tablet_bootstrap.cc:654] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.240249 13274 catalog_manager.cc:5484] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.241168 13569 tablet_bootstrap.cc:654] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.242197 13749 consensus_queue.cc:1035] T 3ec3306783ad4c918421e3ae57924197 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.246582 13569 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.246740 13569 ts_tablet_manager.cc:1367] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.003s
I20240503 14:12:53.248348 13814 consensus_queue.cc:1035] T 96ff759f510546409387dfd2383ec352 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:53.247416 13569 raft_consensus.cc:348] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.249394 13569 raft_consensus.cc:374] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.249464 13569 raft_consensus.cc:729] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.249683 13569 consensus_queue.cc:260] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.250367 13569 ts_tablet_manager.cc:1398] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:53.250656 13569 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.251452 13570 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.251590 13570 ts_tablet_manager.cc:1367] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.002s
I20240503 14:12:53.252341 13570 raft_consensus.cc:348] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.252499 13569 tablet_bootstrap.cc:654] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.252543 13570 raft_consensus.cc:374] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.252593 13570 raft_consensus.cc:729] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.254211 13570 consensus_queue.cc:260] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.254508 13569 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.254634 13569 ts_tablet_manager.cc:1367] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240503 14:12:53.254827 13570 ts_tablet_manager.cc:1398] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:53.255116 13570 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.255379 13569 raft_consensus.cc:348] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.255573 13569 raft_consensus.cc:374] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.255622 13569 raft_consensus.cc:729] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.255862 13569 consensus_queue.cc:260] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.256476 13569 ts_tablet_manager.cc:1398] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:53.256245 13277 catalog_manager.cc:5484] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.256726 13569 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.256794 13277 catalog_manager.cc:5484] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.257068 13568 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.257194 13568 ts_tablet_manager.cc:1367] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.084s user 0.037s sys 0.032s
I20240503 14:12:53.258522 13570 tablet_bootstrap.cc:654] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.258503 13569 tablet_bootstrap.cc:654] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.257205 13277 catalog_manager.cc:5484] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.260116 13568 raft_consensus.cc:348] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.260241 13568 raft_consensus.cc:374] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.260272 13568 raft_consensus.cc:729] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.260411 13568 consensus_queue.cc:260] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.260828 13568 ts_tablet_manager.cc:1398] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20240503 14:12:53.261032 13568 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.267748 13568 tablet_bootstrap.cc:654] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.271628 13818 raft_consensus.cc:482] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.271783 13818 raft_consensus.cc:504] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.272382 13818 leader_election.cc:288] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.272514 13569 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.272665 13569 ts_tablet_manager.cc:1367] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20240503 14:12:53.273111 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.273309 13453 raft_consensus.cc:2454] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.273437 13569 raft_consensus.cc:348] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.273552 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.273622 13569 raft_consensus.cc:374] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.273669 13569 raft_consensus.cc:729] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.273865 13569 consensus_queue.cc:260] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.274088 13493 leader_election.cc:302] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
W20240503 14:12:53.274339 13493 leader_election.cc:341] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.274547 13569 ts_tablet_manager.cc:1398] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.274744 13814 raft_consensus.cc:2781] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.274827 13814 raft_consensus.cc:482] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.274878 13569 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.274893 13814 raft_consensus.cc:3037] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.276525 13655 consensus_queue.cc:1035] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.279518 13814 raft_consensus.cc:504] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.279803 13570 tablet_bootstrap.cc:492] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.279933 13570 ts_tablet_manager.cc:1367] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.008s
I20240503 14:12:53.280038 13569 tablet_bootstrap.cc:654] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.280143 13814 leader_election.cc:288] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.282069 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.282212 13453 raft_consensus.cc:3037] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.281177 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
W20240503 14:12:53.283991 13493 leader_election.cc:341] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.284961 13453 raft_consensus.cc:2454] T 3ded91c8b2d947d6968811a5c7f66fc5 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.285343 13493 leader_election.cc:302] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.285693 13814 raft_consensus.cc:2781] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.285799 13814 raft_consensus.cc:686] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.286139 13570 raft_consensus.cc:348] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.286341 13570 raft_consensus.cc:374] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.286386 13570 raft_consensus.cc:729] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.286607 13570 consensus_queue.cc:260] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.287284 13570 ts_tablet_manager.cc:1398] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20240503 14:12:53.287575 13570 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.287382 13814 consensus_queue.cc:237] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.288650 13568 tablet_bootstrap.cc:492] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.289238 13568 ts_tablet_manager.cc:1367] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.005s
I20240503 14:12:53.296094 13568 raft_consensus.cc:348] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.296355 13568 raft_consensus.cc:374] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.296424 13568 raft_consensus.cc:729] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.296434 13818 raft_consensus.cc:482] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.296602 13818 raft_consensus.cc:504] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.297278 13818 leader_election.cc:288] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.297955 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.298785 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa59a1a71e92475eb287f0cdf7558884" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.296615 13568 consensus_queue.cc:260] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.301940 13493 leader_election.cc:302] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.302377 13818 raft_consensus.cc:2726] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.303666 13568 ts_tablet_manager.cc:1398] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20240503 14:12:53.303972 13568 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.306102 13568 tablet_bootstrap.cc:654] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.308712 13627 raft_consensus.cc:482] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.308879 13627 raft_consensus.cc:504] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.309587 13627 leader_election.cc:288] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.310999 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.311944 13493 leader_election.cc:341] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.312623 13570 tablet_bootstrap.cc:654] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.314647 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:53.315320 13493 leader_election.cc:341] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.315449 13493 leader_election.cc:302] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.317298 13526 raft_consensus.cc:3037] T fa59a1a71e92475eb287f0cdf7558884 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.318118 13627 raft_consensus.cc:2726] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.321066 13621 consensus_queue.cc:1035] T fa59a1a71e92475eb287f0cdf7558884 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.324554 13569 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.324717 13569 ts_tablet_manager.cc:1367] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.050s user 0.017s sys 0.011s
I20240503 14:12:53.325402 13569 raft_consensus.cc:348] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.325559 13569 raft_consensus.cc:374] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.325603 13569 raft_consensus.cc:729] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.325793 13569 consensus_queue.cc:260] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.325811 13276 catalog_manager.cc:5484] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.326331 13569 ts_tablet_manager.cc:1398] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.326632 13569 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.328199 13569 tablet_bootstrap.cc:654] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
W20240503 14:12:53.330072 13325 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 14:12:53.331761 13570 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.331795 13569 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.331915 13570 ts_tablet_manager.cc:1367] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.007s
I20240503 14:12:53.331915 13569 ts_tablet_manager.cc:1367] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240503 14:12:53.332664 13569 raft_consensus.cc:348] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.332865 13569 raft_consensus.cc:374] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.332913 13569 raft_consensus.cc:729] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.333097 13569 consensus_queue.cc:260] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.333593 13570 raft_consensus.cc:348] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.333724 13570 raft_consensus.cc:374] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.333770 13570 raft_consensus.cc:729] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.333964 13570 consensus_queue.cc:260] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.334429 13569 ts_tablet_manager.cc:1398] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.334547 13570 ts_tablet_manager.cc:1398] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:53.334816 13569 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.335223 13570 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.336810 13570 tablet_bootstrap.cc:654] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.336810 13569 tablet_bootstrap.cc:654] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.351449 13568 tablet_bootstrap.cc:492] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.351634 13568 ts_tablet_manager.cc:1367] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.048s user 0.019s sys 0.015s
I20240503 14:12:53.351804 13570 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.351951 13570 ts_tablet_manager.cc:1367] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.015s
I20240503 14:12:53.352239 13568 raft_consensus.cc:348] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.352362 13569 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.352432 13568 raft_consensus.cc:374] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.352494 13568 raft_consensus.cc:729] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.352535 13569 ts_tablet_manager.cc:1367] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.012s
I20240503 14:12:53.352674 13570 raft_consensus.cc:348] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.352833 13570 raft_consensus.cc:374] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.352733 13568 consensus_queue.cc:260] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.352895 13570 raft_consensus.cc:729] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.353113 13570 consensus_queue.cc:260] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.353222 13569 raft_consensus.cc:348] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.353471 13569 raft_consensus.cc:374] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.353529 13569 raft_consensus.cc:729] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.353746 13569 consensus_queue.cc:260] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.354406 13569 ts_tablet_manager.cc:1398] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.354655 13569 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.354712 13570 ts_tablet_manager.cc:1398] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20240503 14:12:53.354960 13570 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.357105 13569 tablet_bootstrap.cc:654] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.357132 13570 tablet_bootstrap.cc:654] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.359436 13568 ts_tablet_manager.cc:1398] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20240503 14:12:53.359758 13568 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.361548 13568 tablet_bootstrap.cc:654] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.364537 13377 raft_consensus.cc:3037] T b04c12317b434827849e93569eb4e50c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.366767 13569 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.366916 13569 ts_tablet_manager.cc:1367] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.010s
I20240503 14:12:53.367038 13570 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.367157 13570 ts_tablet_manager.cc:1367] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20240503 14:12:53.367677 13569 raft_consensus.cc:348] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.367858 13569 raft_consensus.cc:374] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.367954 13569 raft_consensus.cc:729] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.367918 13627 consensus_queue.cc:1035] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.367856 13570 raft_consensus.cc:348] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.368098 13570 raft_consensus.cc:374] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.368145 13570 raft_consensus.cc:729] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.368158 13569 consensus_queue.cc:260] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.368794 13569 ts_tablet_manager.cc:1398] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.368681 13570 consensus_queue.cc:260] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.369169 13569 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.370277 13570 ts_tablet_manager.cc:1398] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240503 14:12:53.370568 13570 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.370920 13569 tablet_bootstrap.cc:654] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.372159 13570 tablet_bootstrap.cc:654] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.379437 13570 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.379667 13570 ts_tablet_manager.cc:1367] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20240503 14:12:53.380492 13570 raft_consensus.cc:348] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.380750 13570 raft_consensus.cc:374] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.380841 13570 raft_consensus.cc:729] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.381112 13570 consensus_queue.cc:260] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.381804 13570 ts_tablet_manager.cc:1398] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.382282 13570 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.385808 13570 tablet_bootstrap.cc:654] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.391567 13568 tablet_bootstrap.cc:492] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.391781 13568 ts_tablet_manager.cc:1367] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.032s user 0.005s sys 0.005s
I20240503 14:12:53.392673 13568 raft_consensus.cc:348] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.394145 13570 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.394332 13570 ts_tablet_manager.cc:1367] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20240503 14:12:53.394701 13568 raft_consensus.cc:374] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.394860 13568 raft_consensus.cc:729] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.395131 13570 raft_consensus.cc:348] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.395138 13568 consensus_queue.cc:260] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.395354 13570 raft_consensus.cc:374] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.395457 13570 raft_consensus.cc:729] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.395689 13570 consensus_queue.cc:260] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.395839 13627 consensus_queue.cc:1035] T b04c12317b434827849e93569eb4e50c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.395922 13568 ts_tablet_manager.cc:1398] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:53.396229 13568 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.400544 13569 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.400758 13569 ts_tablet_manager.cc:1367] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.023s
I20240503 14:12:53.401510 13569 raft_consensus.cc:348] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.401758 13569 raft_consensus.cc:374] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.401854 13569 raft_consensus.cc:729] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.402117 13569 consensus_queue.cc:260] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.402529 13568 tablet_bootstrap.cc:654] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.402655 13569 ts_tablet_manager.cc:1398] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.402997 13569 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: Bootstrap starting.
I20240503 14:12:53.404599 13621 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:53.410048 13570 ts_tablet_manager.cc:1398] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20240503 14:12:53.410607 13627 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.411257 13595 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.411406 13595 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.412827 13595 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.412861 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.413414 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.414140 13419 leader_election.cc:341] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.414326 13627 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.414539 13569 tablet_bootstrap.cc:654] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.415045 13526 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.415609 13570 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.415438 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.416538 13627 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.416949 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.418174 13450 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.418462 13418 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
W20240503 14:12:53.419299 13493 leader_election.cc:341] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.419541 13493 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.419843 13627 raft_consensus.cc:2781] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.419869 13595 raft_consensus.cc:2781] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.421293 13627 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.422047 13595 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.422171 13595 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.423306 13627 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.423262 13818 consensus_queue.cc:1035] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20240503 14:12:53.423760 13526 raft_consensus.cc:3037] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.433879 13814 raft_consensus.cc:482] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.434162 13814 raft_consensus.cc:504] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.436559 13814 leader_election.cc:288] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.436590 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edbd41f1f36442948cf2d14487f2fddf" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.436518 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edbd41f1f36442948cf2d14487f2fddf" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.437201 13450 raft_consensus.cc:2454] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
W20240503 14:12:53.438292 13493 leader_election.cc:341] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.438539 13493 leader_election.cc:302] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.440282 13814 raft_consensus.cc:2781] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.441288 13627 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.442203 13814 raft_consensus.cc:482] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.442327 13814 raft_consensus.cc:3037] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.443768 13627 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.444294 13621 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20240503 14:12:53.444164 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.445549 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
W20240503 14:12:53.446380 13493 leader_election.cc:341] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.448786 13570 tablet_bootstrap.cc:654] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.452653 13568 tablet_bootstrap.cc:492] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.452844 13568 ts_tablet_manager.cc:1367] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.014s
I20240503 14:12:53.450193 13595 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.453688 13568 raft_consensus.cc:348] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.454331 13450 raft_consensus.cc:2379] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 91066aa139a64459b70c70e9d02fe3e1 in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:53.455129 13814 raft_consensus.cc:504] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.455653 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.455950 13814 leader_election.cc:288] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
W20240503 14:12:53.456233 13419 leader_election.cc:341] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.456296 13568 raft_consensus.cc:374] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.456388 13568 raft_consensus.cc:729] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.456696 13568 consensus_queue.cc:260] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.457217 13493 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.457377 13568 ts_tablet_manager.cc:1398] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20240503 14:12:53.457705 13568 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.457628 13818 consensus_queue.cc:1035] T 1dfb820527284be694af068e5c804906 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.458079 13818 raft_consensus.cc:2726] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.460795 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edbd41f1f36442948cf2d14487f2fddf" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.461030 13450 raft_consensus.cc:3037] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.461993 13568 tablet_bootstrap.cc:654] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.462181 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edbd41f1f36442948cf2d14487f2fddf" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.464687 13450 raft_consensus.cc:2454] T edbd41f1f36442948cf2d14487f2fddf P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.465204 13593 raft_consensus.cc:482] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.465399 13593 raft_consensus.cc:504] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.466156 13593 leader_election.cc:288] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.466883 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029feeb3cf3d4ff4a598be4b31293dec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.467144 13528 raft_consensus.cc:2454] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.467653 13418 leader_election.cc:302] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.467979 13593 raft_consensus.cc:2781] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.468099 13593 raft_consensus.cc:482] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.468210 13593 raft_consensus.cc:3037] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.470265 13568 tablet_bootstrap.cc:492] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.470441 13568 ts_tablet_manager.cc:1367] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s
I20240503 14:12:53.470870 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029feeb3cf3d4ff4a598be4b31293dec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.471313 13568 raft_consensus.cc:348] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:53.471488 13419 leader_election.cc:341] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.471535 13568 raft_consensus.cc:374] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.471675 13568 raft_consensus.cc:729] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.471954 13568 consensus_queue.cc:260] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.472728 13568 ts_tablet_manager.cc:1398] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.473047 13568 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.473042 13493 leader_election.cc:302] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.473306 13818 raft_consensus.cc:2781] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.473464 13818 raft_consensus.cc:686] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.473721 13818 consensus_queue.cc:237] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.474947 13568 tablet_bootstrap.cc:654] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
W20240503 14:12:53.474906 13493 leader_election.cc:341] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.478539 13621 raft_consensus.cc:482] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.478706 13621 raft_consensus.cc:504] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.479364 13621 leader_election.cc:288] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.480065 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.480162 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.480423 13450 raft_consensus.cc:2454] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.480420 13528 raft_consensus.cc:2454] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.481489 13343 leader_election.cc:302] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.482337 13621 raft_consensus.cc:2781] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.482460 13621 raft_consensus.cc:482] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.482563 13621 raft_consensus.cc:3037] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.483331 13568 tablet_bootstrap.cc:492] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.483525 13568 ts_tablet_manager.cc:1367] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.001s
I20240503 14:12:53.484302 13568 raft_consensus.cc:348] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.484551 13568 raft_consensus.cc:374] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.484628 13568 raft_consensus.cc:729] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.484926 13568 consensus_queue.cc:260] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.485266 13621 raft_consensus.cc:504] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.485585 13568 ts_tablet_manager.cc:1398] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.485843 13568 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.486886 13593 raft_consensus.cc:504] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.487592 13568 tablet_bootstrap.cc:654] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.488021 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029feeb3cf3d4ff4a598be4b31293dec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.488197 13528 raft_consensus.cc:3037] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.491673 13818 raft_consensus.cc:482] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.491868 13818 raft_consensus.cc:504] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.492543 13818 leader_election.cc:288] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.493360 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029feeb3cf3d4ff4a598be4b31293dec" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.493557 13375 raft_consensus.cc:3037] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.495553 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.496722 13568 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.496989 13568 ts_tablet_manager.cc:1367] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.001s
I20240503 14:12:53.497761 13749 raft_consensus.cc:482] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.497857 13568 raft_consensus.cc:348] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.497916 13749 raft_consensus.cc:504] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.498564 13749 leader_election.cc:288] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.498909 13568 raft_consensus.cc:374] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.498876 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.499024 13568 raft_consensus.cc:729] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.499291 13568 consensus_queue.cc:260] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:53.499751 13493 leader_election.cc:341] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.499980 13493 leader_election.cc:341] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.500118 13493 leader_election.cc:302] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.500187 13568 ts_tablet_manager.cc:1398] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240503 14:12:53.500353 13749 raft_consensus.cc:2726] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.500968 13568 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.500885 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.501291 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
W20240503 14:12:53.501396 13493 leader_election.cc:341] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.501508 13454 raft_consensus.cc:2454] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.503408 13568 tablet_bootstrap.cc:654] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.504060 13829 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.512713 13528 raft_consensus.cc:2454] T 029feeb3cf3d4ff4a598be4b31293dec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.513924 13418 leader_election.cc:302] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.514324 13829 raft_consensus.cc:2781] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.514456 13829 raft_consensus.cc:686] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:53.514712 13829 consensus_queue.cc:237] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.516062 13623 raft_consensus.cc:482] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.516227 13623 raft_consensus.cc:504] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.516899 13623 leader_election.cc:288] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.517719 13623 raft_consensus.cc:482] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.517866 13623 raft_consensus.cc:504] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.518443 13623 leader_election.cc:288] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.517657 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.518842 13454 raft_consensus.cc:2379] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:53.519169 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.519404 13527 raft_consensus.cc:2454] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.519498 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.519727 13454 raft_consensus.cc:2454] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.519946 13343 leader_election.cc:302] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.520360 13623 raft_consensus.cc:2781] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.520496 13623 raft_consensus.cc:482] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.520602 13623 raft_consensus.cc:3037] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.524297 13623 raft_consensus.cc:504] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.535846 13528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03eaf58191a94b0ab4ef6ad226ca695a" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.536715 13343 leader_election.cc:302] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.537062 13655 raft_consensus.cc:3037] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.540093 13655 raft_consensus.cc:2726] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.541486 13681 raft_consensus.cc:482] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.541664 13681 raft_consensus.cc:504] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.542405 13681 leader_election.cc:288] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.543123 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
W20240503 14:12:53.543701 13418 leader_election.cc:341] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.544756 13593 leader_election.cc:288] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.546275 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.547902 13419 leader_election.cc:341] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.548053 13419 leader_election.cc:302] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.548559 13576 raft_consensus.cc:482] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.548740 13576 raft_consensus.cc:504] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.549218 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.549456 13527 raft_consensus.cc:2379] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 16559a1767cd4197b59673a1a99035a8 in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:53.548573 13681 raft_consensus.cc:2726] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.550029 13418 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8; no voters: 7fac721f53074af6930b046ab54bb83f, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.549429 13576 leader_election.cc:288] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.550344 13576 raft_consensus.cc:2726] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.550570 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b820e9f27194e9d9304d7f36f965b13" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.550756 13527 raft_consensus.cc:2454] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:53.551441 13418 leader_election.cc:302] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.551961 13576 raft_consensus.cc:2781] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.552057 13576 raft_consensus.cc:482] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.552126 13576 raft_consensus.cc:3037] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.555280 13576 raft_consensus.cc:504] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.555639 13655 raft_consensus.cc:482] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.555809 13655 raft_consensus.cc:504] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.556505 13655 leader_election.cc:288] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.556540 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b820e9f27194e9d9304d7f36f965b13" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.557289 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d5ee607c954f9393f1c1a6da677624" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.557484 13527 raft_consensus.cc:2454] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.557332 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d5ee607c954f9393f1c1a6da677624" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.557729 13454 raft_consensus.cc:2454] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:53.558166 13344 leader_election.cc:302] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.558442 13622 raft_consensus.cc:2781] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.558517 13622 raft_consensus.cc:482] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.558588 13622 raft_consensus.cc:3037] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.561663 13622 raft_consensus.cc:504] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.564607 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b820e9f27194e9d9304d7f36f965b13" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.564898 13525 raft_consensus.cc:3037] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.568245 13525 raft_consensus.cc:2454] T 6b820e9f27194e9d9304d7f36f965b13 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.568904 13418 leader_election.cc:302] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.570447 13681 raft_consensus.cc:2781] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.570647 13681 raft_consensus.cc:686] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:53.570984 13681 consensus_queue.cc:237] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.572847 13622 leader_election.cc:288] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.573418 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d5ee607c954f9393f1c1a6da677624" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.573658 13454 raft_consensus.cc:3037] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.576906 13454 raft_consensus.cc:2454] T 39d5ee607c954f9393f1c1a6da677624 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.577525 13344 leader_election.cc:302] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.578240 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39d5ee607c954f9393f1c1a6da677624" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.579263 13527 raft_consensus.cc:3037] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.582229 13622 raft_consensus.cc:2781] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.582528 13622 raft_consensus.cc:686] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:53.582926 13622 consensus_queue.cc:237] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
W20240503 14:12:53.584519 13419 leader_election.cc:341] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.584741 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b820e9f27194e9d9304d7f36f965b13" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.585170 13576 leader_election.cc:288] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
W20240503 14:12:53.585311 13419 leader_election.cc:341] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.586642 13595 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.588851 13375 raft_consensus.cc:2454] T 029feeb3cf3d4ff4a598be4b31293dec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:53.596581 13493 leader_election.cc:302] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.596917 13627 raft_consensus.cc:482] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.597113 13627 raft_consensus.cc:504] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.597821 13627 leader_election.cc:288] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.598166 13627 raft_consensus.cc:2781] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.598291 13627 raft_consensus.cc:482] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.598390 13627 raft_consensus.cc:3037] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.601442 13627 raft_consensus.cc:504] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.602321 13627 leader_election.cc:288] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.603201 13595 consensus_queue.cc:1035] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.603888 13575 raft_consensus.cc:482] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.604068 13575 raft_consensus.cc:504] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.604754 13575 leader_election.cc:288] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.605530 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.606534 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ec02d284e1592683bfa6f9e4ae7" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.606808 13525 raft_consensus.cc:2379] T 16195ec02d284e1592683bfa6f9e4ae7 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:53.607223 13343 leader_election.cc:302] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.607667 13575 raft_consensus.cc:3037] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.611040 13575 raft_consensus.cc:2726] T 16195ec02d284e1592683bfa6f9e4ae7 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.614444 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.614773 13451 raft_consensus.cc:3037] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.617933 13451 raft_consensus.cc:2454] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.618952 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5c52e9e2cf45f79bb854b8ba51e00e" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.619658 13525 raft_consensus.cc:3037] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.620573 13814 raft_consensus.cc:482] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.620780 13814 raft_consensus.cc:504] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.621657 13814 leader_election.cc:288] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.623023 13525 raft_consensus.cc:2454] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.623477 13344 leader_election.cc:302] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.624166 13622 raft_consensus.cc:2781] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.624359 13622 raft_consensus.cc:686] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:53.625116 13622 consensus_queue.cc:237] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.619022 13623 leader_election.cc:288] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.631134 13527 raft_consensus.cc:2454] T 39d5ee607c954f9393f1c1a6da677624 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.635624 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.636656 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.636898 13450 raft_consensus.cc:2454] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.640748 13655 consensus_queue.cc:1035] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.650964 13595 consensus_queue.cc:1035] T 16195ec02d284e1592683bfa6f9e4ae7 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.650897 13623 consensus_queue.cc:1035] T 7d44249041c74ca48414ad2c6ca44ff8 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.663443 13575 raft_consensus.cc:482] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.663710 13575 raft_consensus.cc:504] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.664418 13575 leader_election.cc:288] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.665045 13450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.665309 13450 raft_consensus.cc:2379] T 5d7e006f0efc4a83b450a01b1166291c P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:53.668232 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.668464 13451 raft_consensus.cc:3037] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.673889 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d7e006f0efc4a83b450a01b1166291c" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.674506 13343 leader_election.cc:302] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.674841 13575 raft_consensus.cc:3037] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.676296 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.677839 13575 raft_consensus.cc:2726] T 5d7e006f0efc4a83b450a01b1166291c P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.682072 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:53.685034 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.691099 13569 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: No bootstrap required, opened a new log
I20240503 14:12:53.691367 13569 ts_tablet_manager.cc:1367] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: Time spent bootstrapping tablet: real 0.288s user 0.104s sys 0.128s
I20240503 14:12:53.692452 13569 raft_consensus.cc:348] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.692701 13569 raft_consensus.cc:374] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.692814 13569 raft_consensus.cc:729] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.693063 13569 consensus_queue.cc:260] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.693665 13569 ts_tablet_manager.cc:1398] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20240503 14:12:53.695554 13493 leader_election.cc:341] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.695998 13814 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:53.696679 13493 leader_election.cc:341] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.696914 13493 leader_election.cc:341] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.700968 13376 raft_consensus.cc:3037] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.710724 13451 raft_consensus.cc:2454] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.714643 13277 catalog_manager.cc:5484] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.724510 13277 catalog_manager.cc:5484] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.732800 13493 leader_election.cc:302] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.733222 13595 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.733542 13814 raft_consensus.cc:2781] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.733634 13814 raft_consensus.cc:482] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.733695 13814 raft_consensus.cc:3037] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.736716 13814 raft_consensus.cc:504] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.742151 13814 leader_election.cc:288] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.743582 13814 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:53.744791 13493 leader_election.cc:341] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.745043 13493 leader_election.cc:302] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91066aa139a64459b70c70e9d02fe3e1; no voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.745368 13814 raft_consensus.cc:2726] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.746960 13814 consensus_queue.cc:1035] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.748101 13814 consensus_queue.cc:1035] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.748749 13493 leader_election.cc:302] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters: 7fac721f53074af6930b046ab54bb83f
I20240503 14:12:53.750391 13814 raft_consensus.cc:2781] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.750666 13814 raft_consensus.cc:686] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.751006 13814 consensus_queue.cc:237] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.753190 13375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.753758 13379 raft_consensus.cc:3037] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.755014 13627 consensus_queue.cc:1035] T 5d7e006f0efc4a83b450a01b1166291c P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.756331 13627 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.759721 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.759936 13454 raft_consensus.cc:3037] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.764459 13454 raft_consensus.cc:2454] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.767673 13570 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.767772 13568 tablet_bootstrap.cc:492] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.767903 13568 ts_tablet_manager.cc:1367] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.267s user 0.086s sys 0.140s
I20240503 14:12:53.767994 13570 ts_tablet_manager.cc:1367] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.358s user 0.099s sys 0.189s
I20240503 14:12:53.768776 13568 raft_consensus.cc:348] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.768851 13570 raft_consensus.cc:348] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.768998 13568 raft_consensus.cc:374] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.769052 13568 raft_consensus.cc:729] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.769050 13570 raft_consensus.cc:374] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.769227 13570 raft_consensus.cc:729] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.769249 13568 consensus_queue.cc:260] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.769399 13570 consensus_queue.cc:260] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.769752 13568 ts_tablet_manager.cc:1398] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:53.769956 13570 ts_tablet_manager.cc:1398] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.770072 13568 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.770321 13570 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.771900 13568 tablet_bootstrap.cc:654] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.771908 13570 tablet_bootstrap.cc:654] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.772368 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.772557 13454 raft_consensus.cc:3037] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.773891 13523 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "560d40e7c91846f6a02539f867cb7431" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:53.774117 13523 raft_consensus.cc:3037] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.775705 13454 raft_consensus.cc:2454] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.776145 13344 leader_election.cc:302] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:53.776453 13655 raft_consensus.cc:2781] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.776556 13655 raft_consensus.cc:686] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:53.776815 13655 consensus_queue.cc:237] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.777096 13523 raft_consensus.cc:2454] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:53.778232 13621 leader_election.cc:288] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.785583 13622 raft_consensus.cc:482] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.785902 13622 raft_consensus.cc:504] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.787273 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.788638 13622 leader_election.cc:288] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.788795 13527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b94535bb3734538b0c8850f2b24eaf5" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.789595 13343 leader_election.cc:302] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.794827 13621 raft_consensus.cc:2726] T 7b94535bb3734538b0c8850f2b24eaf5 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20240503 14:12:53.810953 13627 consensus_queue.cc:1035] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.825937 13277 catalog_manager.cc:5484] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.827517 13277 catalog_manager.cc:5484] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.837208 13276 catalog_manager.cc:5484] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:53.839974 13493 leader_election.cc:302] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.841321 13627 raft_consensus.cc:2781] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.841473 13627 raft_consensus.cc:686] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.841722 13627 consensus_queue.cc:237] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.842198 13818 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:53.850991 13493 leader_election.cc:341] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.851648 13627 consensus_queue.cc:1035] T 7b94535bb3734538b0c8850f2b24eaf5 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:53.854355 13493 consensus_peers.cc:485] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 -> Peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Couldn't send request to peer 7fac721f53074af6930b046ab54bb83f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:53.854684 13749 consensus_queue.cc:1035] T 66e224eae0d04ee1a8851dd89a88289b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.854889 13277 catalog_manager.cc:5484] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.855476 13277 catalog_manager.cc:5484] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.872030 13814 consensus_queue.cc:1035] T 3ded91c8b2d947d6968811a5c7f66fc5 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.881922 13568 tablet_bootstrap.cc:492] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.882141 13568 ts_tablet_manager.cc:1367] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.112s user 0.050s sys 0.054s
I20240503 14:12:53.882284 13570 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.882490 13570 ts_tablet_manager.cc:1367] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.112s user 0.055s sys 0.047s
I20240503 14:12:53.882957 13568 raft_consensus.cc:348] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.883188 13568 raft_consensus.cc:374] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.883241 13568 raft_consensus.cc:729] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.883451 13570 raft_consensus.cc:348] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.883484 13568 consensus_queue.cc:260] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.883708 13570 raft_consensus.cc:374] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.883848 13570 raft_consensus.cc:729] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.884084 13570 consensus_queue.cc:260] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.884267 13568 ts_tablet_manager.cc:1398] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.884557 13568 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.884734 13570 ts_tablet_manager.cc:1398] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.885036 13570 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8: Bootstrap starting.
I20240503 14:12:53.886302 13568 tablet_bootstrap.cc:654] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.888260 13570 tablet_bootstrap.cc:654] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.890954 13749 raft_consensus.cc:482] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.891161 13749 raft_consensus.cc:504] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.892051 13749 leader_election.cc:288] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.892918 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.893138 13451 raft_consensus.cc:2454] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 0.
I20240503 14:12:53.893556 13493 leader_election.cc:302] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.893843 13627 raft_consensus.cc:2781] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:53.893920 13627 raft_consensus.cc:482] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:53.894007 13627 raft_consensus.cc:3037] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.894321 13568 tablet_bootstrap.cc:492] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.894452 13568 ts_tablet_manager.cc:1367] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20240503 14:12:53.895180 13568 raft_consensus.cc:348] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.895576 13568 raft_consensus.cc:374] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.895639 13568 raft_consensus.cc:729] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.895864 13568 consensus_queue.cc:260] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.896478 13568 ts_tablet_manager.cc:1398] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:53.896631 13627 raft_consensus.cc:504] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.896760 13568 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.897192 13627 leader_election.cc:288] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:53.897871 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:53.898386 13568 tablet_bootstrap.cc:654] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.898806 13451 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:53.899027 13451 raft_consensus.cc:3037] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.901786 13451 raft_consensus.cc:2454] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91066aa139a64459b70c70e9d02fe3e1 in term 1.
I20240503 14:12:53.902598 13493 leader_election.cc:302] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:53.904920 13276 catalog_manager.cc:5484] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.907397 13568 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.914397 13568 ts_tablet_manager.cc:1367] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.002s
I20240503 14:12:53.915203 13568 raft_consensus.cc:348] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.915370 13568 raft_consensus.cc:374] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.915428 13568 raft_consensus.cc:729] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.915624 13568 consensus_queue.cc:260] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.916105 13568 ts_tablet_manager.cc:1398] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20240503 14:12:53.916360 13568 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.917680 13568 tablet_bootstrap.cc:654] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.909080 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "91066aa139a64459b70c70e9d02fe3e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
W20240503 14:12:53.918697 13493 leader_election.cc:341] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
W20240503 14:12:53.919071 13493 leader_election.cc:341] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): Illegal state: must be running to vote when last-logged opid is not known
I20240503 14:12:53.919673 13627 raft_consensus.cc:2781] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:53.919795 13627 raft_consensus.cc:686] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Becoming Leader. State: Replica: 91066aa139a64459b70c70e9d02fe3e1, State: Running, Role: LEADER
I20240503 14:12:53.920020 13627 consensus_queue.cc:237] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.929729 13570 tablet_bootstrap.cc:492] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8: No bootstrap required, opened a new log
I20240503 14:12:53.929900 13570 ts_tablet_manager.cc:1367] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8: Time spent bootstrapping tablet: real 0.045s user 0.016s sys 0.006s
I20240503 14:12:53.928020 13276 catalog_manager.cc:5484] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131). New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } }
I20240503 14:12:53.930747 13570 raft_consensus.cc:348] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.930940 13570 raft_consensus.cc:374] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.931003 13570 raft_consensus.cc:729] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.931198 13570 consensus_queue.cc:260] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.931690 13570 ts_tablet_manager.cc:1398] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:53.933290 13568 tablet_bootstrap.cc:492] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.933482 13568 ts_tablet_manager.cc:1367] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20240503 14:12:53.936782 13568 raft_consensus.cc:348] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.937042 13568 raft_consensus.cc:374] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.937119 13568 raft_consensus.cc:729] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.937323 13568 consensus_queue.cc:260] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.937906 13568 ts_tablet_manager.cc:1398] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20240503 14:12:53.938241 13568 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.939900 13568 tablet_bootstrap.cc:654] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.946611 13568 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.946813 13568 ts_tablet_manager.cc:1367] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20240503 14:12:53.947510 13568 raft_consensus.cc:348] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.947772 13568 raft_consensus.cc:374] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.947849 13568 raft_consensus.cc:729] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.948067 13568 consensus_queue.cc:260] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.948700 13568 ts_tablet_manager.cc:1398] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240503 14:12:53.949141 13568 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.949698 13593 consensus_queue.cc:1035] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.951186 13568 tablet_bootstrap.cc:654] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.953496 13568 tablet_bootstrap.cc:492] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.953665 13568 ts_tablet_manager.cc:1367] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20240503 14:12:53.954625 13568 raft_consensus.cc:348] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.954847 13568 raft_consensus.cc:374] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.954921 13568 raft_consensus.cc:729] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.955190 13568 consensus_queue.cc:260] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.955698 13568 ts_tablet_manager.cc:1398] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240503 14:12:53.955960 13568 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.957675 13568 tablet_bootstrap.cc:654] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.957734 13681 consensus_queue.cc:1035] T 029feeb3cf3d4ff4a598be4b31293dec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.962404 13568 tablet_bootstrap.cc:492] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.962563 13568 ts_tablet_manager.cc:1367] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20240503 14:12:53.963932 13568 raft_consensus.cc:348] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.964282 13568 raft_consensus.cc:374] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.964371 13568 raft_consensus.cc:729] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.964584 13568 consensus_queue.cc:260] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.965150 13568 ts_tablet_manager.cc:1398] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240503 14:12:53.965497 13568 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.967280 13568 tablet_bootstrap.cc:654] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.969427 13568 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.970170 13655 raft_consensus.cc:482] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:53.970221 13568 ts_tablet_manager.cc:1367] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240503 14:12:53.970316 13655 raft_consensus.cc:504] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.971011 13655 leader_election.cc:288] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:53.971380 13524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:53.971343 13568 raft_consensus.cc:348] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.971684 13568 raft_consensus.cc:374] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.971782 13568 raft_consensus.cc:729] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.971872 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77cf310d80ce4590af30673b67e30d38" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:53.972098 13454 raft_consensus.cc:2379] T 77cf310d80ce4590af30673b67e30d38 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:53.972111 13568 consensus_queue.cc:260] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.972635 13344 leader_election.cc:302] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:53.972738 13568 ts_tablet_manager.cc:1398] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:53.972993 13655 raft_consensus.cc:3037] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:53.973198 13568 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Bootstrap starting.
I20240503 14:12:53.975678 13655 raft_consensus.cc:2726] T 77cf310d80ce4590af30673b67e30d38 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:53.976018 13655 consensus_queue.cc:1035] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.980621 13621 consensus_queue.cc:1035] T 39d5ee607c954f9393f1c1a6da677624 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:53.990760 13568 tablet_bootstrap.cc:654] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Neither blocks nor log segments found. Creating new log.
I20240503 14:12:53.992578 13568 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: No bootstrap required, opened a new log
I20240503 14:12:53.992743 13568 ts_tablet_manager.cc:1367] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.001s
I20240503 14:12:53.993276 13568 raft_consensus.cc:348] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.993440 13568 raft_consensus.cc:374] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240503 14:12:53.993474 13568 raft_consensus.cc:729] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Initialized, Role: FOLLOWER
I20240503 14:12:53.993645 13568 consensus_queue.cc:260] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:53.994131 13568 ts_tablet_manager.cc:1398] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240503 14:12:54.042032 13376 raft_consensus.cc:3037] T edbd41f1f36442948cf2d14487f2fddf P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.045043 13627 consensus_queue.cc:1035] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.048980 13814 consensus_queue.cc:1035] T edbd41f1f36442948cf2d14487f2fddf P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.063594 13593 consensus_queue.cc:1035] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.066807 13376 raft_consensus.cc:3037] T 6b820e9f27194e9d9304d7f36f965b13 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.069644 13681 consensus_queue.cc:1035] T 6b820e9f27194e9d9304d7f36f965b13 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.082926 13621 consensus_queue.cc:1035] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.083734 13681 raft_consensus.cc:482] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.083868 13681 raft_consensus.cc:504] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.084446 13681 leader_election.cc:288] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.084717 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:54.084919 13376 raft_consensus.cc:2454] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:54.084949 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.085143 13525 raft_consensus.cc:2454] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:54.085310 13419 leader_election.cc:302] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:54.085685 13681 raft_consensus.cc:2781] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:54.085763 13681 raft_consensus.cc:482] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:54.085832 13681 raft_consensus.cc:3037] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.087186 13621 consensus_queue.cc:1035] T 9a5c52e9e2cf45f79bb854b8ba51e00e P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.090200 13681 raft_consensus.cc:504] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.091208 13524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:54.091399 13524 raft_consensus.cc:3037] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.091125 13376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c9795c8fe964648b5a8be26c32f6499" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:54.093370 13376 raft_consensus.cc:3037] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.094066 13524 raft_consensus.cc:2454] T 2c9795c8fe964648b5a8be26c32f6499 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:54.094372 13681 leader_election.cc:288] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.094386 13418 leader_election.cc:302] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:54.094626 13681 raft_consensus.cc:2781] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:54.094729 13681 raft_consensus.cc:686] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:54.094964 13681 consensus_queue.cc:237] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.095677 13376 raft_consensus.cc:2454] T 2c9795c8fe964648b5a8be26c32f6499 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:54.097816 13277 catalog_manager.cc:5484] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:54.122637 13621 raft_consensus.cc:482] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.122836 13621 raft_consensus.cc:504] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.123436 13621 leader_election.cc:288] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.123907 13524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.123908 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7438e76bfd9a47bf88d201f6caa059c4" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:54.124197 13454 raft_consensus.cc:2379] T 7438e76bfd9a47bf88d201f6caa059c4 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:54.124570 13344 leader_election.cc:302] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:54.124876 13621 raft_consensus.cc:3037] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.126889 13621 raft_consensus.cc:2726] T 7438e76bfd9a47bf88d201f6caa059c4 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:54.134161 13621 raft_consensus.cc:482] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.134310 13621 raft_consensus.cc:504] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.134815 13621 leader_election.cc:288] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.135174 13524 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.135174 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:54.135401 13454 raft_consensus.cc:2454] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:54.135401 13524 raft_consensus.cc:2454] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 0.
I20240503 14:12:54.135773 13344 leader_election.cc:302] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:54.136112 13621 raft_consensus.cc:2781] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:54.136179 13621 raft_consensus.cc:482] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:54.136243 13621 raft_consensus.cc:3037] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.138116 13621 raft_consensus.cc:504] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.138610 13621 leader_election.cc:288] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Requested vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.138906 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8"
I20240503 14:12:54.138989 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6bdb73037ea74c09a4a1cdf983284299" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:54.139045 13454 raft_consensus.cc:3037] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.139158 13525 raft_consensus.cc:3037] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.140826 13454 raft_consensus.cc:2454] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:54.141139 13344 leader_election.cc:302] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:54.141348 13621 raft_consensus.cc:2781] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:54.141490 13621 raft_consensus.cc:686] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Becoming Leader. State: Replica: 7fac721f53074af6930b046ab54bb83f, State: Running, Role: LEADER
I20240503 14:12:54.141732 13621 consensus_queue.cc:237] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.141948 13525 raft_consensus.cc:2454] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fac721f53074af6930b046ab54bb83f in term 1.
I20240503 14:12:54.144999 13277 catalog_manager.cc:5484] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fac721f53074af6930b046ab54bb83f (127.12.1.129). New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:54.170861 13621 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.171072 13621 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.171643 13621 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.172119 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.172122 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:54.172360 13525 raft_consensus.cc:2379] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:54.172374 13454 raft_consensus.cc:2379] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 16559a1767cd4197b59673a1a99035a8 in this term.
I20240503 14:12:54.172741 13343 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:54.172946 13621 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.174873 13621 raft_consensus.cc:2726] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:54.185084 13621 raft_consensus.cc:482] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.185263 13621 raft_consensus.cc:504] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.185854 13621 leader_election.cc:288] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.186321 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.186321 13454 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ded91c8b2d947d6968811a5c7f66fc5" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:54.186851 13344 leader_election.cc:302] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:54.187068 13621 raft_consensus.cc:2726] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:54.223856 13681 raft_consensus.cc:482] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.224153 13681 raft_consensus.cc:504] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.224877 13681 leader_election.cc:288] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.225375 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:54.225375 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.225659 13525 raft_consensus.cc:2454] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:54.225659 13377 raft_consensus.cc:2454] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 0.
I20240503 14:12:54.226087 13419 leader_election.cc:302] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:54.226344 13681 raft_consensus.cc:2781] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240503 14:12:54.226481 13681 raft_consensus.cc:482] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:54.226348 13749 consensus_queue.cc:1035] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.226565 13681 raft_consensus.cc:3037] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.229094 13681 raft_consensus.cc:504] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.230180 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:54.230333 13377 raft_consensus.cc:3037] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.233144 13377 raft_consensus.cc:2454] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:54.233206 13655 consensus_queue.cc:1035] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.233618 13419 leader_election.cc:302] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 7fac721f53074af6930b046ab54bb83f; no voters:
I20240503 14:12:54.233937 13829 raft_consensus.cc:2781] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader election won for term 1
I20240503 14:12:54.234089 13829 raft_consensus.cc:686] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:54.234318 13829 consensus_queue.cc:237] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.234449 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21bd6acda964ddf87d770e3fdbe3789" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:54.234398 13818 consensus_queue.cc:1035] T 7438e76bfd9a47bf88d201f6caa059c4 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.234602 13525 raft_consensus.cc:3037] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.237884 13525 raft_consensus.cc:2454] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:54.238188 13277 catalog_manager.cc:5484] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:54.240378 13655 consensus_queue.cc:1035] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.243296 13623 raft_consensus.cc:482] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:54.243438 13623 raft_consensus.cc:504] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:54.244072 13623 leader_election.cc:288] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.244386 13681 leader_election.cc:288] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:54.244354 13453 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16559a1767cd4197b59673a1a99035a8" is_pre_election: true
I20240503 14:12:54.244633 13453 raft_consensus.cc:2379] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fac721f53074af6930b046ab54bb83f in current term 1: Already voted for candidate 91066aa139a64459b70c70e9d02fe3e1 in this term.
I20240503 14:12:54.244906 13526 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c8bbae71c641998f6f6171ad848075" candidate_uuid: "7fac721f53074af6930b046ab54bb83f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:54.245388 13343 leader_election.cc:302] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fac721f53074af6930b046ab54bb83f; no voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1
I20240503 14:12:54.245755 13623 raft_consensus.cc:3037] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.248467 13623 raft_consensus.cc:2726] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240503 14:12:54.269658 13377 raft_consensus.cc:3037] T 3ded91c8b2d947d6968811a5c7f66fc5 P 7fac721f53074af6930b046ab54bb83f [term 0 FOLLOWER]: Advancing to term 1
I20240503 14:12:54.303125 13818 consensus_queue.cc:1035] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.306885 13818 consensus_queue.cc:1035] T 77cf310d80ce4590af30673b67e30d38 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240503 14:12:54.337646 13325 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20240503 14:12:54.419582 13749 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.423875 13749 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.529379 13593 consensus_queue.cc:1035] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.529379 13655 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.534075 13593 consensus_queue.cc:1035] T 2c9795c8fe964648b5a8be26c32f6499 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.542865 13623 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.727627 13593 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:54.731256 13681 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:55.090238 13829 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240503 14:12:55.090437 13829 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:55.091040 13829 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:55.091579 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1" is_pre_election: true
I20240503 14:12:55.091581 13378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f" is_pre_election: true
I20240503 14:12:55.091809 13525 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:55.091842 13378 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 1.
I20240503 14:12:55.092196 13418 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:55.092468 13829 raft_consensus.cc:2781] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20240503 14:12:55.092548 13829 raft_consensus.cc:482] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240503 14:12:55.092614 13829 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:55.094516 13829 raft_consensus.cc:504] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:55.095041 13829 leader_election.cc:288] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 2 election: Requested vote from peers 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667), 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:55.095438 13525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91066aa139a64459b70c70e9d02fe3e1"
I20240503 14:12:55.095445 13377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4e8c8e857544418b02526960eb52a66" candidate_uuid: "16559a1767cd4197b59673a1a99035a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fac721f53074af6930b046ab54bb83f"
I20240503 14:12:55.095607 13525 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:55.095616 13377 raft_consensus.cc:3037] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Advancing to term 2
I20240503 14:12:55.097909 13525 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 2.
I20240503 14:12:55.097903 13377 raft_consensus.cc:2454] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16559a1767cd4197b59673a1a99035a8 in term 2.
I20240503 14:12:55.098369 13418 leader_election.cc:302] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16559a1767cd4197b59673a1a99035a8, 91066aa139a64459b70c70e9d02fe3e1; no voters:
I20240503 14:12:55.098899 13829 raft_consensus.cc:2781] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 2 FOLLOWER]: Leader election won for term 2
I20240503 14:12:55.099030 13829 raft_consensus.cc:686] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [term 2 LEADER]: Becoming Leader. State: Replica: 16559a1767cd4197b59673a1a99035a8, State: Running, Role: LEADER
I20240503 14:12:55.099251 13829 consensus_queue.cc:237] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } }
I20240503 14:12:55.102167 13275 catalog_manager.cc:5484] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: term changed from 0 to 2, leader changed from <none> to 16559a1767cd4197b59673a1a99035a8 (127.12.1.130). New cstate: current_term: 2 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:55.501957 13378 raft_consensus.cc:1261] T e4e8c8e857544418b02526960eb52a66 P 7fac721f53074af6930b046ab54bb83f [term 2 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20240503 14:12:55.502588 13593 consensus_queue.cc:1035] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:55.506794 13525 raft_consensus.cc:1261] T e4e8c8e857544418b02526960eb52a66 P 91066aa139a64459b70c70e9d02fe3e1 [term 2 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20240503 14:12:55.507369 13593 consensus_queue.cc:1035] T e4e8c8e857544418b02526960eb52a66 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240503 14:12:55.635632 12294 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240503 14:12:55.639170 13965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:55.664395 13966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240503 14:12:55.665654 13968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240503 14:12:55.673758 12294 server_base.cc:1034] running on GCE node
I20240503 14:12:55.674232 12294 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20240503 14:12:55.674329 12294 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20240503 14:12:55.674381 12294 hybrid_clock.cc:648] HybridClock initialized: now 1714745575674364 us; error 0 us; skew 500 ppm
I20240503 14:12:55.674575 12294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240503 14:12:55.682189 12294 webserver.cc:460] Webserver started at http://127.12.1.132:33255/ using document root <none> and password file <none>
I20240503 14:12:55.682492 12294 fs_manager.cc:359] Metadata directory not provided
I20240503 14:12:55.682858 12294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240503 14:12:55.683387 12294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240503 14:12:55.684742 12294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-3-root/instance:
uuid: "eccadd5cf6154568b49f30afd9e746d2"
format_stamp: "Formatted at 2024-05-03 14:12:55 on dist-test-slave-6fwv"
I20240503 14:12:55.688092 12294 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20240503 14:12:55.689775 13973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:55.690318 12294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20240503 14:12:55.690449 12294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-3-root
uuid: "eccadd5cf6154568b49f30afd9e746d2"
format_stamp: "Formatted at 2024-05-03 14:12:55 on dist-test-slave-6fwv"
I20240503 14:12:55.690572 12294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240503 14:12:55.726668 12294 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240503 14:12:55.727289 12294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240503 14:12:55.727926 12294 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240503 14:12:55.728801 12294 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240503 14:12:55.728863 12294 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:55.728967 12294 ts_tablet_manager.cc:590] Registered 0 tablets
I20240503 14:12:55.729005 12294 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240503 14:12:55.743693 12294 rpc_server.cc:307] RPC server started. Bound to: 127.12.1.132:38483
I20240503 14:12:55.743726 14035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.1.132:38483 every 8 connection(s)
I20240503 14:12:55.744678 12294 auto_leader_rebalancer-test.cc:405] add a tserver: eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:55.751418 14036 heartbeater.cc:347] Connected to a master server at 127.12.1.190:35453
I20240503 14:12:55.751560 14036 heartbeater.cc:464] Registering TS with master...
I20240503 14:12:55.751900 14036 heartbeater.cc:511] Master 127.12.1.190:35453 requested a full tablet report, sending...
I20240503 14:12:55.752750 13277 ts_manager.cc:194] Registered new tserver with Master: eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483)
I20240503 14:12:55.753599 13277 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59272
I20240503 14:12:56.375038 13378 consensus_queue.cc:237] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.377892 13454 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.378239 13525 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.378597 13621 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.379108 13621 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.382017 13621 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.384521 13453 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
W20240503 14:12:56.388417 13343 consensus_peers.cc:485] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bdb73037ea74c09a4a1cdf983284299. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:56.389621 13277 catalog_manager.cc:5484] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:56.392941 13525 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.399502 13453 consensus_queue.cc:237] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.403076 13378 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.403726 14055 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.405676 13525 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.406224 14055 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.408484 14055 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.410374 13525 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.412163 13377 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.414606 13275 catalog_manager.cc:5484] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:56.415418 13453 consensus_queue.cc:237] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
W20240503 14:12:56.417459 13418 consensus_peers.cc:485] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97f96b0aa5024991b4ad009c8c1393ec. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:56.419121 13377 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.419555 14055 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.419660 13525 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:12:56.420540 13418 consensus_peers.cc:485] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc278b18dbe543c797160688d0d08403. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:56.420730 14055 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.423334 13829 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.424186 13525 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.430541 13277 catalog_manager.cc:5484] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.435925 13526 consensus_queue.cc:237] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.437372 13377 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.440009 13378 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.440521 13749 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.440970 13453 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:56.441825 13749 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:56.444878 13749 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.445370 13453 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.453299 13276 catalog_manager.cc:5484] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:56.456424 13378 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
W20240503 14:12:56.459249 13492 consensus_peers.cc:485] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee5723bf5c86432d9320810b098874f2. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:56.754791 14036 heartbeater.cc:503] Master 127.12.1.190:35453 was elected leader, sending a full tablet report...
I20240503 14:12:56.812465 14070 ts_tablet_manager.cc:902] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667)
I20240503 14:12:56.814924 14070 tablet_copy_client.cc:308] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.129:38667
I20240503 14:12:56.824375 13389 tablet_copy_service.cc:140] P 7fac721f53074af6930b046ab54bb83f: Received BeginTabletCopySession request for tablet 6bdb73037ea74c09a4a1cdf983284299 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:39622)
I20240503 14:12:56.824677 13389 tablet_copy_service.cc:161] P 7fac721f53074af6930b046ab54bb83f: Beginning new tablet copy session on tablet 6bdb73037ea74c09a4a1cdf983284299 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:39622: session id = eccadd5cf6154568b49f30afd9e746d2-6bdb73037ea74c09a4a1cdf983284299
I20240503 14:12:56.828963 13389 tablet_copy_source_session.cc:205] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:56.831380 14070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6bdb73037ea74c09a4a1cdf983284299. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:56.838258 14070 tablet_copy_client.cc:783] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:56.838627 14070 tablet_copy_client.cc:647] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:56.841315 14070 tablet_copy_client.cc:523] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:56.845454 14070 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:56.853005 14070 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:56.853420 14070 tablet_bootstrap.cc:492] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:56.853659 14070 ts_tablet_manager.cc:1367] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.003s
I20240503 14:12:56.854506 14070 raft_consensus.cc:348] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.854794 14070 raft_consensus.cc:729] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:56.855015 14070 consensus_queue.cc:260] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.855862 14070 ts_tablet_manager.cc:1398] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.001s sys 0.004s
I20240503 14:12:56.856642 13389 tablet_copy_service.cc:342] P 7fac721f53074af6930b046ab54bb83f: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-6bdb73037ea74c09a4a1cdf983284299 received from {username='slave'} at 127.0.0.1:39622
I20240503 14:12:56.856755 13389 tablet_copy_service.cc:433] P 7fac721f53074af6930b046ab54bb83f: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-6bdb73037ea74c09a4a1cdf983284299 on tablet 6bdb73037ea74c09a4a1cdf983284299 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:56.902630 14070 ts_tablet_manager.cc:902] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:56.904064 14070 tablet_copy_client.cc:308] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.131:34815
I20240503 14:12:56.911275 13538 tablet_copy_service.cc:140] P 91066aa139a64459b70c70e9d02fe3e1: Received BeginTabletCopySession request for tablet ee5723bf5c86432d9320810b098874f2 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:40374)
I20240503 14:12:56.911479 13538 tablet_copy_service.cc:161] P 91066aa139a64459b70c70e9d02fe3e1: Beginning new tablet copy session on tablet ee5723bf5c86432d9320810b098874f2 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:40374: session id = eccadd5cf6154568b49f30afd9e746d2-ee5723bf5c86432d9320810b098874f2
I20240503 14:12:56.913807 13538 tablet_copy_source_session.cc:205] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:56.915059 14070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee5723bf5c86432d9320810b098874f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:56.921243 14070 tablet_copy_client.cc:783] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:56.921523 14070 tablet_copy_client.cc:647] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:56.923153 14070 tablet_copy_client.cc:523] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:56.926776 14070 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:56.932551 14070 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:56.933741 14070 tablet_bootstrap.cc:492] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:56.934052 14070 ts_tablet_manager.cc:1367] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.001s
I20240503 14:12:56.934856 14070 raft_consensus.cc:348] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.935048 14070 raft_consensus.cc:729] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:56.935266 14070 consensus_queue.cc:260] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.936282 14070 ts_tablet_manager.cc:1398] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:12:56.936888 13538 tablet_copy_service.cc:342] P 91066aa139a64459b70c70e9d02fe3e1: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-ee5723bf5c86432d9320810b098874f2 received from {username='slave'} at 127.0.0.1:40374
I20240503 14:12:56.937036 13538 tablet_copy_service.cc:433] P 91066aa139a64459b70c70e9d02fe3e1: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-ee5723bf5c86432d9320810b098874f2 on tablet ee5723bf5c86432d9320810b098874f2 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:56.945488 14070 ts_tablet_manager.cc:902] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:56.946882 14070 tablet_copy_client.cc:308] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:12:56.953310 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet dc278b18dbe543c797160688d0d08403 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:12:56.953553 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet dc278b18dbe543c797160688d0d08403 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-dc278b18dbe543c797160688d0d08403
I20240503 14:12:56.956115 13464 tablet_copy_source_session.cc:205] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:56.957387 14070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc278b18dbe543c797160688d0d08403. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:56.963124 14070 tablet_copy_client.cc:783] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:56.963366 14070 tablet_copy_client.cc:647] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:56.965013 14070 tablet_copy_client.cc:523] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:56.967577 14070 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:56.973884 14070 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:56.974320 14070 tablet_bootstrap.cc:492] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:56.974570 14070 ts_tablet_manager.cc:1367] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.007s user 0.008s sys 0.000s
I20240503 14:12:56.975780 14070 raft_consensus.cc:348] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.976004 14070 raft_consensus.cc:729] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:56.976190 14070 consensus_queue.cc:260] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:56.976716 14070 ts_tablet_manager.cc:1398] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240503 14:12:56.977365 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-dc278b18dbe543c797160688d0d08403 received from {username='slave'} at 127.0.0.1:58506
I20240503 14:12:56.977456 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-dc278b18dbe543c797160688d0d08403 on tablet dc278b18dbe543c797160688d0d08403 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:57.006762 14070 ts_tablet_manager.cc:902] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:57.008152 14070 tablet_copy_client.cc:308] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:12:57.008776 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet 97f96b0aa5024991b4ad009c8c1393ec from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:12:57.008935 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet 97f96b0aa5024991b4ad009c8c1393ec from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-97f96b0aa5024991b4ad009c8c1393ec
I20240503 14:12:57.011582 13464 tablet_copy_source_session.cc:205] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:57.012873 14070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97f96b0aa5024991b4ad009c8c1393ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:57.018095 14070 tablet_copy_client.cc:783] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:57.018350 14070 tablet_copy_client.cc:647] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:57.019694 14070 tablet_copy_client.cc:523] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:57.022945 14070 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:57.029052 14070 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:57.029443 14070 tablet_bootstrap.cc:492] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:57.029723 14070 ts_tablet_manager.cc:1367] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240503 14:12:57.030483 14070 raft_consensus.cc:348] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:57.030773 14070 raft_consensus.cc:729] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:57.030951 14070 consensus_queue.cc:260] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:57.031456 14070 ts_tablet_manager.cc:1398] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240503 14:12:57.032182 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-97f96b0aa5024991b4ad009c8c1393ec received from {username='slave'} at 127.0.0.1:58506
I20240503 14:12:57.032298 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-97f96b0aa5024991b4ad009c8c1393ec on tablet 97f96b0aa5024991b4ad009c8c1393ec with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:57.247746 14011 raft_consensus.cc:1203] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:12:57.325306 14011 raft_consensus.cc:1203] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:12:57.454190 14011 raft_consensus.cc:1203] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:12:57.470572 14011 raft_consensus.cc:1203] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:12:57.794462 14046 raft_consensus.cc:1050] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:12:57.795598 14046 consensus_queue.cc:237] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.798156 14011 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.798141 13526 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.798147 13449 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.798725 14094 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.798998 14046 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.799481 14099 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.802740 14094 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.803678 13453 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.806927 13526 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.810705 13276 catalog_manager.cc:5484] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:57.820290 14011 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.831516 13377 consensus_queue.cc:237] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.833382 14011 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.833468 13525 raft_consensus.cc:1261] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.834158 14099 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.834470 14094 consensus_queue.cc:1035] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.837013 14094 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.837739 13525 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.837857 14011 raft_consensus.cc:2932] T 6bdb73037ea74c09a4a1cdf983284299 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.841688 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6bdb73037ea74c09a4a1cdf983284299 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:12:57.843164 13277 catalog_manager.cc:5484] T 6bdb73037ea74c09a4a1cdf983284299 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.848049 13436 tablet_service.cc:1514] Processing DeleteTablet for tablet 6bdb73037ea74c09a4a1cdf983284299 with delete_type TABLET_DATA_TOMBSTONED (TS 16559a1767cd4197b59673a1a99035a8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58466
I20240503 14:12:57.849092 14107 tablet_replica.cc:330] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: stopping tablet replica
I20240503 14:12:57.849325 14107 raft_consensus.cc:2229] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:57.849607 14107 raft_consensus.cc:2258] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:57.850658 14107 ts_tablet_manager.cc:1875] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:12:57.856252 14107 ts_tablet_manager.cc:1888] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:12:57.856431 14107 log.cc:1196] T 6bdb73037ea74c09a4a1cdf983284299 P 16559a1767cd4197b59673a1a99035a8: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/wals/6bdb73037ea74c09a4a1cdf983284299
I20240503 14:12:57.857334 13263 catalog_manager.cc:4830] TS 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): tablet 6bdb73037ea74c09a4a1cdf983284299 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:12:57.874543 14064 raft_consensus.cc:1050] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:12:57.875363 14064 consensus_queue.cc:237] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.877779 13525 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.878165 13377 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.878455 14109 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.878919 14011 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.878867 14064 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.880718 14109 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.884827 14064 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.885955 13377 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.889286 13526 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.892668 13275 catalog_manager.cc:5484] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.893497 14011 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.901507 13453 consensus_queue.cc:237] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.903548 13377 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.903712 14011 raft_consensus.cc:1261] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.904451 14064 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.904718 14109 consensus_queue.cc:1035] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.907044 14095 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.907830 13377 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.910074 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 97f96b0aa5024991b4ad009c8c1393ec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:12:57.912377 13274 catalog_manager.cc:5484] T 97f96b0aa5024991b4ad009c8c1393ec P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:57.913112 14011 raft_consensus.cc:2932] T 97f96b0aa5024991b4ad009c8c1393ec P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.916328 13517 tablet_service.cc:1514] Processing DeleteTablet for tablet 97f96b0aa5024991b4ad009c8c1393ec with delete_type TABLET_DATA_TOMBSTONED (TS 91066aa139a64459b70c70e9d02fe3e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40342
I20240503 14:12:57.917163 14113 tablet_replica.cc:330] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: stopping tablet replica
I20240503 14:12:57.917384 14113 raft_consensus.cc:2229] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:57.917824 14113 raft_consensus.cc:2258] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:57.919320 14113 ts_tablet_manager.cc:1875] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:12:57.923929 13749 raft_consensus.cc:1050] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:12:57.924768 13749 consensus_queue.cc:237] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.927953 13449 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.928347 14113 ts_tablet_manager.cc:1888] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:12:57.928478 14113 log.cc:1196] T 97f96b0aa5024991b4ad009c8c1393ec P 91066aa139a64459b70c70e9d02fe3e1: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/wals/97f96b0aa5024991b4ad009c8c1393ec
I20240503 14:12:57.928603 14011 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.928812 14096 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.929457 13262 catalog_manager.cc:4830] TS 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): tablet 97f96b0aa5024991b4ad009c8c1393ec (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:12:57.930469 13377 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.931125 14116 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.932880 14096 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.936580 14096 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.938566 13377 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.941591 13449 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.945801 13274 catalog_manager.cc:5484] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:12:57.948545 14011 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.953400 13526 consensus_queue.cc:237] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.955209 13377 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.956136 14116 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.956032 14011 raft_consensus.cc:1261] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.956768 14116 consensus_queue.cc:1035] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.958515 14115 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.959669 14011 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.961954 14064 raft_consensus.cc:1050] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:12:57.962697 14064 consensus_queue.cc:237] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.962848 13262 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet ee5723bf5c86432d9320810b098874f2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:12:57.962939 13377 raft_consensus.cc:2932] T ee5723bf5c86432d9320810b098874f2 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.965240 13275 catalog_manager.cc:5484] T ee5723bf5c86432d9320810b098874f2 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.969132 13436 tablet_service.cc:1514] Processing DeleteTablet for tablet ee5723bf5c86432d9320810b098874f2 with delete_type TABLET_DATA_TOMBSTONED (TS 16559a1767cd4197b59673a1a99035a8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58466
I20240503 14:12:57.969420 14107 tablet_replica.cc:330] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: stopping tablet replica
I20240503 14:12:57.969640 14107 raft_consensus.cc:2229] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:57.969844 14107 raft_consensus.cc:2258] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:57.970837 14107 ts_tablet_manager.cc:1875] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:12:57.971269 14011 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.971654 14095 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.973771 13377 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.974210 14095 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.977135 14107 ts_tablet_manager.cc:1888] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:12:57.977234 14107 log.cc:1196] T ee5723bf5c86432d9320810b098874f2 P 16559a1767cd4197b59673a1a99035a8: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/wals/ee5723bf5c86432d9320810b098874f2
I20240503 14:12:57.977865 13263 catalog_manager.cc:4830] TS 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): tablet ee5723bf5c86432d9320810b098874f2 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:12:57.978535 13526 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:12:57.979005 14095 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:12:57.980156 14097 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.981912 13526 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.983733 14011 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.986074 13277 catalog_manager.cc:5484] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:12:57.988287 13377 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:57.995559 13453 consensus_queue.cc:237] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:12:57.997484 14011 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.997956 14109 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:57.998884 13525 raft_consensus.cc:1261] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:12:57.999431 14109 consensus_queue.cc:1035] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:12:58.001511 14011 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:58.002158 13526 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:58.007361 13277 catalog_manager.cc:5484] T dc278b18dbe543c797160688d0d08403 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:58.010596 14095 raft_consensus.cc:2932] T dc278b18dbe543c797160688d0d08403 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:12:58.011112 13360 tablet_service.cc:1514] Processing DeleteTablet for tablet dc278b18dbe543c797160688d0d08403 with delete_type TABLET_DATA_TOMBSTONED (TS 7fac721f53074af6930b046ab54bb83f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39580
I20240503 14:12:58.011766 14125 tablet_replica.cc:330] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: stopping tablet replica
I20240503 14:12:58.012014 14125 raft_consensus.cc:2229] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:12:58.012233 14125 raft_consensus.cc:2258] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:12:58.012895 14125 ts_tablet_manager.cc:1875] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:12:58.014130 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc278b18dbe543c797160688d0d08403 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:12:58.019992 14125 ts_tablet_manager.cc:1888] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:12:58.020123 14125 log.cc:1196] T dc278b18dbe543c797160688d0d08403 P 7fac721f53074af6930b046ab54bb83f: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/wals/dc278b18dbe543c797160688d0d08403
I20240503 14:12:58.020795 13263 catalog_manager.cc:4830] TS 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): tablet dc278b18dbe543c797160688d0d08403 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:12:59.031617 13377 consensus_queue.cc:237] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.034108 13453 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:12:59.034250 13343 consensus_peers.cc:485] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e32b84c7de40447b8d01baa8385c7817. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:59.034626 14094 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.035212 13525 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.035697 14094 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.037690 14128 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.038398 13453 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.041571 13525 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.043921 13453 consensus_queue.cc:237] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.044066 13277 catalog_manager.cc:5484] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.047390 13526 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:12:59.047674 13418 consensus_peers.cc:485] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19240561f76443c4b24b30ead79fc478. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:59.047919 13377 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.048046 14124 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.048421 14126 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.051148 14124 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.057308 13525 consensus_queue.cc:237] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.058336 13526 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.061010 13378 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.061093 13453 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.056597 13377 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
W20240503 14:12:59.062402 13492 consensus_peers.cc:485] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5c8bbae71c641998f6f6171ad848075. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:59.063048 14116 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.063643 14116 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.068593 14115 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.069478 13449 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.076454 13378 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.079715 13449 consensus_queue.cc:237] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.082850 13275 catalog_manager.cc:5484] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:12:59.083272 13377 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.083544 13275 catalog_manager.cc:5484] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.083791 14126 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 14:12:59.086109 13418 consensus_peers.cc:485] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a21bd6acda964ddf87d770e3fdbe3789. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:12:59.087491 13525 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:12:59.088064 14135 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:12:59.089617 14126 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.090348 13377 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.097795 13274 catalog_manager.cc:5484] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.098577 13526 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:12:59.425452 14146 ts_tablet_manager.cc:902] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:59.430503 14146 tablet_copy_client.cc:308] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:12:59.431124 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet 19240561f76443c4b24b30ead79fc478 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:12:59.431280 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet 19240561f76443c4b24b30ead79fc478 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-19240561f76443c4b24b30ead79fc478
I20240503 14:12:59.434190 13464 tablet_copy_source_session.cc:205] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:59.436432 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19240561f76443c4b24b30ead79fc478. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:59.442680 14146 tablet_copy_client.cc:783] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:59.442982 14146 tablet_copy_client.cc:647] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:59.444651 14146 tablet_copy_client.cc:523] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:59.447535 14146 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:59.453402 14146 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:59.453771 14146 tablet_bootstrap.cc:492] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:59.454072 14146 ts_tablet_manager.cc:1367] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.001s
I20240503 14:12:59.455181 14146 raft_consensus.cc:348] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.455423 14146 raft_consensus.cc:729] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:59.456859 14146 consensus_queue.cc:260] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.457813 14146 ts_tablet_manager.cc:1398] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240503 14:12:59.458631 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-19240561f76443c4b24b30ead79fc478 received from {username='slave'} at 127.0.0.1:58506
I20240503 14:12:59.458750 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-19240561f76443c4b24b30ead79fc478 on tablet 19240561f76443c4b24b30ead79fc478 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:59.481632 14146 ts_tablet_manager.cc:902] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:12:59.487250 14146 tablet_copy_client.cc:308] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:12:59.487988 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet a21bd6acda964ddf87d770e3fdbe3789 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:12:59.488163 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet a21bd6acda964ddf87d770e3fdbe3789 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-a21bd6acda964ddf87d770e3fdbe3789
I20240503 14:12:59.491299 13464 tablet_copy_source_session.cc:205] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:59.492766 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21bd6acda964ddf87d770e3fdbe3789. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:59.499536 14146 tablet_copy_client.cc:783] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:59.499847 14146 tablet_copy_client.cc:647] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:59.501443 14146 tablet_copy_client.cc:523] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:59.505093 14146 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:59.511987 14146 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:59.512579 14146 tablet_bootstrap.cc:492] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:59.512842 14146 ts_tablet_manager.cc:1367] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20240503 14:12:59.513598 14146 raft_consensus.cc:348] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.514343 14146 raft_consensus.cc:729] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:59.514551 14146 consensus_queue.cc:260] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.515228 14146 ts_tablet_manager.cc:1398] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
I20240503 14:12:59.515954 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-a21bd6acda964ddf87d770e3fdbe3789 received from {username='slave'} at 127.0.0.1:58506
I20240503 14:12:59.516095 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-a21bd6acda964ddf87d770e3fdbe3789 on tablet a21bd6acda964ddf87d770e3fdbe3789 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:59.623175 14146 ts_tablet_manager.cc:902] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667)
I20240503 14:12:59.641309 14161 ts_tablet_manager.cc:902] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:12:59.698385 14146 tablet_copy_client.cc:308] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.129:38667
I20240503 14:12:59.699048 13389 tablet_copy_service.cc:140] P 7fac721f53074af6930b046ab54bb83f: Received BeginTabletCopySession request for tablet e32b84c7de40447b8d01baa8385c7817 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:39622)
I20240503 14:12:59.699209 13389 tablet_copy_service.cc:161] P 7fac721f53074af6930b046ab54bb83f: Beginning new tablet copy session on tablet e32b84c7de40447b8d01baa8385c7817 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:39622: session id = eccadd5cf6154568b49f30afd9e746d2-e32b84c7de40447b8d01baa8385c7817
I20240503 14:12:59.702342 13389 tablet_copy_source_session.cc:205] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:59.703727 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e32b84c7de40447b8d01baa8385c7817. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:59.710455 14146 tablet_copy_client.cc:783] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:59.710712 14146 tablet_copy_client.cc:647] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:59.712164 14146 tablet_copy_client.cc:523] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:59.715881 14146 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:59.723626 14161 tablet_copy_client.cc:308] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.131:34815
I20240503 14:12:59.724684 13538 tablet_copy_service.cc:140] P 91066aa139a64459b70c70e9d02fe3e1: Received BeginTabletCopySession request for tablet a5c8bbae71c641998f6f6171ad848075 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:40374)
I20240503 14:12:59.724944 13538 tablet_copy_service.cc:161] P 91066aa139a64459b70c70e9d02fe3e1: Beginning new tablet copy session on tablet a5c8bbae71c641998f6f6171ad848075 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:40374: session id = eccadd5cf6154568b49f30afd9e746d2-a5c8bbae71c641998f6f6171ad848075
I20240503 14:12:59.733554 13538 tablet_copy_source_session.cc:205] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:12:59.734819 14161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c8bbae71c641998f6f6171ad848075. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:12:59.744827 14161 tablet_copy_client.cc:783] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:12:59.744933 14146 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:59.745085 14161 tablet_copy_client.cc:647] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:12:59.745308 14146 tablet_bootstrap.cc:492] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:59.745594 14146 ts_tablet_manager.cc:1367] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.030s user 0.011s sys 0.009s
I20240503 14:12:59.746819 14161 tablet_copy_client.cc:523] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:12:59.746934 14146 raft_consensus.cc:348] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.747215 14146 raft_consensus.cc:729] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:59.747427 14146 consensus_queue.cc:260] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.748836 14146 ts_tablet_manager.cc:1398] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240503 14:12:59.749707 13389 tablet_copy_service.cc:342] P 7fac721f53074af6930b046ab54bb83f: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-e32b84c7de40447b8d01baa8385c7817 received from {username='slave'} at 127.0.0.1:39622
I20240503 14:12:59.749804 13389 tablet_copy_service.cc:433] P 7fac721f53074af6930b046ab54bb83f: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-e32b84c7de40447b8d01baa8385c7817 on tablet e32b84c7de40447b8d01baa8385c7817 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:59.750813 14161 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:12:59.764703 14161 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:12:59.765156 14161 tablet_bootstrap.cc:492] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:12:59.765425 14161 ts_tablet_manager.cc:1367] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.007s
I20240503 14:12:59.766295 14161 raft_consensus.cc:348] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.766570 14161 raft_consensus.cc:729] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:12:59.766768 14161 consensus_queue.cc:260] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:12:59.768869 14161 ts_tablet_manager.cc:1398] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20240503 14:12:59.770220 13538 tablet_copy_service.cc:342] P 91066aa139a64459b70c70e9d02fe3e1: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-a5c8bbae71c641998f6f6171ad848075 received from {username='slave'} at 127.0.0.1:40374
I20240503 14:12:59.770321 13538 tablet_copy_service.cc:433] P 91066aa139a64459b70c70e9d02fe3e1: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-a5c8bbae71c641998f6f6171ad848075 on tablet a5c8bbae71c641998f6f6171ad848075 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:12:59.963987 14011 raft_consensus.cc:1203] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:12:59.971988 14011 raft_consensus.cc:1203] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:00.212985 14010 raft_consensus.cc:1203] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:00.213323 14011 raft_consensus.cc:1203] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:00.417109 14126 raft_consensus.cc:1050] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:00.418030 14126 consensus_queue.cc:237] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.420471 13526 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.420471 14011 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.421067 14168 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.420542 13378 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.421379 14135 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.423940 14168 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.426788 14168 raft_consensus.cc:1050] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:00.427817 14168 consensus_queue.cc:237] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.431635 14010 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.431636 13526 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.432294 14135 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20240503 14:13:00.433571 14135 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.438942 13377 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.441496 14135 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.457171 14168 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.458524 14010 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.461347 13378 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.463297 13524 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.463851 14172 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.464751 13525 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.465085 13277 catalog_manager.cc:5484] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:00.470705 14011 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.470958 13377 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.478861 13276 catalog_manager.cc:5484] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.496299 13453 consensus_queue.cc:237] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.498299 14011 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.498299 13526 raft_consensus.cc:1261] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.498980 14126 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.499284 14135 consensus_queue.cc:1035] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.501674 14126 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.502166 13453 consensus_queue.cc:237] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.503027 13526 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.503777 14011 raft_consensus.cc:2932] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.505587 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 19240561f76443c4b24b30ead79fc478 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:00.509205 13524 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.509516 14011 raft_consensus.cc:1261] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.508988 13275 catalog_manager.cc:5484] T 19240561f76443c4b24b30ead79fc478 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.510305 14177 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.510888 14177 consensus_queue.cc:1035] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.513007 14168 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.518151 13360 tablet_service.cc:1514] Processing DeleteTablet for tablet 19240561f76443c4b24b30ead79fc478 with delete_type TABLET_DATA_TOMBSTONED (TS 7fac721f53074af6930b046ab54bb83f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39580
I20240503 14:13:00.516309 14011 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.519515 13526 raft_consensus.cc:2932] T a21bd6acda964ddf87d770e3fdbe3789 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.523376 13276 catalog_manager.cc:5484] T a21bd6acda964ddf87d770e3fdbe3789 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.525405 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a21bd6acda964ddf87d770e3fdbe3789 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:00.526626 14186 tablet_replica.cc:330] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: stopping tablet replica
I20240503 14:13:00.526822 14186 raft_consensus.cc:2229] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:00.527081 14186 raft_consensus.cc:2258] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:00.527850 14186 ts_tablet_manager.cc:1875] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:00.530287 13360 tablet_service.cc:1514] Processing DeleteTablet for tablet a21bd6acda964ddf87d770e3fdbe3789 with delete_type TABLET_DATA_TOMBSTONED (TS 7fac721f53074af6930b046ab54bb83f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39580
I20240503 14:13:00.534852 14186 ts_tablet_manager.cc:1888] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:00.535185 14186 log.cc:1196] T 19240561f76443c4b24b30ead79fc478 P 7fac721f53074af6930b046ab54bb83f: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/wals/19240561f76443c4b24b30ead79fc478
I20240503 14:13:00.535820 14186 tablet_replica.cc:330] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: stopping tablet replica
I20240503 14:13:00.536036 14186 raft_consensus.cc:2229] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:00.536152 13263 catalog_manager.cc:4830] TS 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): tablet 19240561f76443c4b24b30ead79fc478 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:00.536283 14186 raft_consensus.cc:2258] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:00.537032 14186 ts_tablet_manager.cc:1875] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:00.543826 14186 ts_tablet_manager.cc:1888] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:00.543949 14186 log.cc:1196] T a21bd6acda964ddf87d770e3fdbe3789 P 7fac721f53074af6930b046ab54bb83f: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/wals/a21bd6acda964ddf87d770e3fdbe3789
I20240503 14:13:00.544503 13263 catalog_manager.cc:4830] TS 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): tablet a21bd6acda964ddf87d770e3fdbe3789 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:00.698271 14128 raft_consensus.cc:1050] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:00.699139 14128 consensus_queue.cc:237] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.701562 14011 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.701562 13526 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.702076 13450 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.702138 14128 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.702538 14094 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.702831 14188 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.711311 14094 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.712186 14011 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.712476 13526 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.716347 13450 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.718087 13275 catalog_manager.cc:5484] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.723665 13378 consensus_queue.cc:237] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.725538 14011 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.725541 13450 raft_consensus.cc:1261] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.726063 14094 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.726317 14128 consensus_queue.cc:1035] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.728433 14188 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.730990 14011 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.730965 13450 raft_consensus.cc:2932] T e32b84c7de40447b8d01baa8385c7817 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.731926 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e32b84c7de40447b8d01baa8385c7817 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:00.733886 13274 catalog_manager.cc:5484] T e32b84c7de40447b8d01baa8385c7817 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:00.737867 13517 tablet_service.cc:1514] Processing DeleteTablet for tablet e32b84c7de40447b8d01baa8385c7817 with delete_type TABLET_DATA_TOMBSTONED (TS 91066aa139a64459b70c70e9d02fe3e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40342
I20240503 14:13:00.738725 14116 raft_consensus.cc:1050] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:00.739553 14116 consensus_queue.cc:237] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.751165 13453 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.751410 14193 tablet_replica.cc:330] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: stopping tablet replica
I20240503 14:13:00.751189 14011 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.751165 13377 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:00.751798 14193 raft_consensus.cc:2229] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:00.752061 14193 raft_consensus.cc:2258] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:00.752032 14116 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.752319 14196 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.752820 14137 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:00.753378 14193 ts_tablet_manager.cc:1875] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:00.759958 14193 ts_tablet_manager.cc:1888] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:00.760109 14193 log.cc:1196] T e32b84c7de40447b8d01baa8385c7817 P 91066aa139a64459b70c70e9d02fe3e1: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/wals/e32b84c7de40447b8d01baa8385c7817
I20240503 14:13:00.760901 13262 catalog_manager.cc:4830] TS 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): tablet e32b84c7de40447b8d01baa8385c7817 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:00.762456 14116 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.766121 13377 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.770251 13450 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.770152 14011 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.771030 13277 catalog_manager.cc:5484] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.780421 13524 consensus_queue.cc:237] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:00.782054 14011 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.782476 14195 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.782898 13377 raft_consensus.cc:1261] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:00.783433 14195 consensus_queue.cc:1035] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:00.784772 14137 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.787905 13377 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.788295 14011 raft_consensus.cc:2932] T a5c8bbae71c641998f6f6171ad848075 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:00.791951 13262 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a5c8bbae71c641998f6f6171ad848075 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:00.792711 13277 catalog_manager.cc:5484] T a5c8bbae71c641998f6f6171ad848075 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:00.796643 13436 tablet_service.cc:1514] Processing DeleteTablet for tablet a5c8bbae71c641998f6f6171ad848075 with delete_type TABLET_DATA_TOMBSTONED (TS 16559a1767cd4197b59673a1a99035a8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58466
I20240503 14:13:00.797252 14201 tablet_replica.cc:330] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: stopping tablet replica
I20240503 14:13:00.797439 14201 raft_consensus.cc:2229] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:00.797724 14201 raft_consensus.cc:2258] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:00.799763 14201 ts_tablet_manager.cc:1875] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:00.804172 14201 ts_tablet_manager.cc:1888] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:00.804289 14201 log.cc:1196] T a5c8bbae71c641998f6f6171ad848075 P 16559a1767cd4197b59673a1a99035a8: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/wals/a5c8bbae71c641998f6f6171ad848075
I20240503 14:13:00.804911 13263 catalog_manager.cc:4830] TS 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): tablet a5c8bbae71c641998f6f6171ad848075 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:01.810674 13453 consensus_queue.cc:237] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
W20240503 14:13:01.812737 13418 consensus_peers.cc:485] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 514eb3d2023740edb111da5cc6b6de35. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:01.812880 13524 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.813027 13377 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.813316 14168 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.814605 14204 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.816995 14204 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.817695 13524 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.818002 13377 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.822664 13453 consensus_queue.cc:237] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:01.822676 13274 catalog_manager.cc:5484] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:01.825852 13524 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.826372 13377 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.826386 14204 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.827201 14204 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20240503 14:13:01.827401 13418 consensus_peers.cc:485] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fec024e5ae7c43ebac0fb6f813701797. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:01.829254 14135 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.833405 13524 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.834656 13526 consensus_queue.cc:237] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:01.835541 13377 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
W20240503 14:13:01.836931 13492 consensus_peers.cc:485] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eae4e983cf2042f7b03491e9dd3c38c9. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:01.837949 13378 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.837755 13276 catalog_manager.cc:5484] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:01.838812 14196 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.840384 13453 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.841728 14196 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.842568 14137 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.844784 13376 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.847146 13453 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.850651 13276 catalog_manager.cc:5484] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:01.853209 13524 consensus_queue.cc:237] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
W20240503 14:13:01.856070 13492 consensus_peers.cc:485] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03eaf58191a94b0ab4ef6ad226ca695a. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:01.856997 13453 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.857419 13376 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:01.857434 14137 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.857918 14217 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:01.859645 14137 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.862392 13453 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.863392 13377 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:01.867962 13277 catalog_manager.cc:5484] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:02.192633 14221 ts_tablet_manager.cc:902] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:13:02.194439 14221 tablet_copy_client.cc:308] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:13:02.195076 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet 514eb3d2023740edb111da5cc6b6de35 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:13:02.195209 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet 514eb3d2023740edb111da5cc6b6de35 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-514eb3d2023740edb111da5cc6b6de35
I20240503 14:13:02.197697 13464 tablet_copy_source_session.cc:205] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:13:02.198747 14221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 514eb3d2023740edb111da5cc6b6de35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:13:02.204440 14221 tablet_copy_client.cc:783] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:13:02.204635 14221 tablet_copy_client.cc:647] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:13:02.206120 14221 tablet_copy_client.cc:523] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:13:02.209545 14221 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:13:02.214511 14221 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:13:02.214870 14221 tablet_bootstrap.cc:492] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:13:02.215070 14221 ts_tablet_manager.cc:1367] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20240503 14:13:02.215808 14221 raft_consensus.cc:348] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.216039 14221 raft_consensus.cc:729] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:13:02.216212 14221 consensus_queue.cc:260] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.217917 14221 ts_tablet_manager.cc:1398] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240503 14:13:02.218451 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-514eb3d2023740edb111da5cc6b6de35 received from {username='slave'} at 127.0.0.1:58506
I20240503 14:13:02.218549 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-514eb3d2023740edb111da5cc6b6de35 on tablet 514eb3d2023740edb111da5cc6b6de35 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:13:02.270251 14221 ts_tablet_manager.cc:902] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439)
I20240503 14:13:02.271353 14221 tablet_copy_client.cc:308] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.130:43439
I20240503 14:13:02.271867 13464 tablet_copy_service.cc:140] P 16559a1767cd4197b59673a1a99035a8: Received BeginTabletCopySession request for tablet fec024e5ae7c43ebac0fb6f813701797 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:58506)
I20240503 14:13:02.271979 13464 tablet_copy_service.cc:161] P 16559a1767cd4197b59673a1a99035a8: Beginning new tablet copy session on tablet fec024e5ae7c43ebac0fb6f813701797 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:58506: session id = eccadd5cf6154568b49f30afd9e746d2-fec024e5ae7c43ebac0fb6f813701797
I20240503 14:13:02.274348 13464 tablet_copy_source_session.cc:205] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:13:02.275310 14221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fec024e5ae7c43ebac0fb6f813701797. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:13:02.280179 14221 tablet_copy_client.cc:783] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:13:02.280365 14221 tablet_copy_client.cc:647] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:13:02.281611 14221 tablet_copy_client.cc:523] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:13:02.284253 14221 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:13:02.289047 14221 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:13:02.289296 14221 tablet_bootstrap.cc:492] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:13:02.289481 14221 ts_tablet_manager.cc:1367] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20240503 14:13:02.290098 14221 raft_consensus.cc:348] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.290290 14221 raft_consensus.cc:729] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:13:02.290450 14221 consensus_queue.cc:260] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.290926 14221 ts_tablet_manager.cc:1398] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240503 14:13:02.291587 13464 tablet_copy_service.cc:342] P 16559a1767cd4197b59673a1a99035a8: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-fec024e5ae7c43ebac0fb6f813701797 received from {username='slave'} at 127.0.0.1:58506
I20240503 14:13:02.291679 13464 tablet_copy_service.cc:433] P 16559a1767cd4197b59673a1a99035a8: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-fec024e5ae7c43ebac0fb6f813701797 on tablet fec024e5ae7c43ebac0fb6f813701797 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:13:02.348129 14221 ts_tablet_manager.cc:902] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:13:02.349328 14221 tablet_copy_client.cc:308] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.131:34815
I20240503 14:13:02.349829 13538 tablet_copy_service.cc:140] P 91066aa139a64459b70c70e9d02fe3e1: Received BeginTabletCopySession request for tablet 03eaf58191a94b0ab4ef6ad226ca695a from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:40374)
I20240503 14:13:02.349941 13538 tablet_copy_service.cc:161] P 91066aa139a64459b70c70e9d02fe3e1: Beginning new tablet copy session on tablet 03eaf58191a94b0ab4ef6ad226ca695a from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:40374: session id = eccadd5cf6154568b49f30afd9e746d2-03eaf58191a94b0ab4ef6ad226ca695a
I20240503 14:13:02.352021 13538 tablet_copy_source_session.cc:205] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:13:02.352995 14221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03eaf58191a94b0ab4ef6ad226ca695a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:13:02.358328 14221 tablet_copy_client.cc:783] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:13:02.358526 14221 tablet_copy_client.cc:647] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:13:02.359798 14221 tablet_copy_client.cc:523] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:13:02.362664 14221 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:13:02.367735 14221 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:13:02.368069 14221 tablet_bootstrap.cc:492] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:13:02.368294 14221 ts_tablet_manager.cc:1367] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240503 14:13:02.368822 14221 raft_consensus.cc:348] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.369012 14221 raft_consensus.cc:729] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:13:02.369174 14221 consensus_queue.cc:260] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.369728 14221 ts_tablet_manager.cc:1398] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240503 14:13:02.371357 13538 tablet_copy_service.cc:342] P 91066aa139a64459b70c70e9d02fe3e1: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-03eaf58191a94b0ab4ef6ad226ca695a received from {username='slave'} at 127.0.0.1:40374
I20240503 14:13:02.371436 13538 tablet_copy_service.cc:433] P 91066aa139a64459b70c70e9d02fe3e1: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-03eaf58191a94b0ab4ef6ad226ca695a on tablet 03eaf58191a94b0ab4ef6ad226ca695a with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:13:02.453016 14221 ts_tablet_manager.cc:902] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
I20240503 14:13:02.469127 14221 tablet_copy_client.cc:308] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Beginning tablet copy session from remote peer at address 127.12.1.131:34815
I20240503 14:13:02.469686 13538 tablet_copy_service.cc:140] P 91066aa139a64459b70c70e9d02fe3e1: Received BeginTabletCopySession request for tablet eae4e983cf2042f7b03491e9dd3c38c9 from peer eccadd5cf6154568b49f30afd9e746d2 ({username='slave'} at 127.0.0.1:40374)
I20240503 14:13:02.469806 13538 tablet_copy_service.cc:161] P 91066aa139a64459b70c70e9d02fe3e1: Beginning new tablet copy session on tablet eae4e983cf2042f7b03491e9dd3c38c9 from peer eccadd5cf6154568b49f30afd9e746d2 at {username='slave'} at 127.0.0.1:40374: session id = eccadd5cf6154568b49f30afd9e746d2-eae4e983cf2042f7b03491e9dd3c38c9
I20240503 14:13:02.471644 13538 tablet_copy_source_session.cc:205] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: Tablet Copy: opened 0 blocks and 1 log segments
I20240503 14:13:02.472517 14221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae4e983cf2042f7b03491e9dd3c38c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240503 14:13:02.476611 14221 tablet_copy_client.cc:783] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 0 data blocks...
I20240503 14:13:02.476812 14221 tablet_copy_client.cc:647] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Starting download of 1 WAL segments...
I20240503 14:13:02.478087 14221 tablet_copy_client.cc:523] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240503 14:13:02.480695 14221 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap starting.
I20240503 14:13:02.485893 14221 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240503 14:13:02.486230 14221 tablet_bootstrap.cc:492] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Bootstrap complete.
I20240503 14:13:02.486449 14221 ts_tablet_manager.cc:1367] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.005s
I20240503 14:13:02.487089 14221 raft_consensus.cc:348] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.487306 14221 raft_consensus.cc:729] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: eccadd5cf6154568b49f30afd9e746d2, State: Initialized, Role: LEARNER
I20240503 14:13:02.487484 14221 consensus_queue.cc:260] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:02.488524 14221 ts_tablet_manager.cc:1398] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240503 14:13:02.489318 13538 tablet_copy_service.cc:342] P 91066aa139a64459b70c70e9d02fe3e1: Request end of tablet copy session eccadd5cf6154568b49f30afd9e746d2-eae4e983cf2042f7b03491e9dd3c38c9 received from {username='slave'} at 127.0.0.1:40374
I20240503 14:13:02.489419 13538 tablet_copy_service.cc:433] P 91066aa139a64459b70c70e9d02fe3e1: ending tablet copy session eccadd5cf6154568b49f30afd9e746d2-eae4e983cf2042f7b03491e9dd3c38c9 on tablet eae4e983cf2042f7b03491e9dd3c38c9 with peer eccadd5cf6154568b49f30afd9e746d2
I20240503 14:13:02.678630 14011 raft_consensus.cc:1203] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:02.682055 14011 raft_consensus.cc:1203] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:02.864156 14011 raft_consensus.cc:1203] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:03.019335 14011 raft_consensus.cc:1203] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240503 14:13:03.209549 14204 raft_consensus.cc:1050] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:03.210317 14204 consensus_queue.cc:237] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.212875 13526 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.212884 14011 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.213770 14204 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.214092 13377 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.214190 14245 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.214921 14249 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.217886 14245 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.218468 13377 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.222573 14011 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.223690 13274 catalog_manager.cc:5484] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.247115 13526 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.250880 13453 consensus_queue.cc:237] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.253079 14011 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.255056 14204 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.255810 13377 raft_consensus.cc:1261] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.256299 14204 consensus_queue.cc:1035] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.258297 14254 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.259510 14011 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.261966 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fec024e5ae7c43ebac0fb6f813701797 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:03.263226 13376 raft_consensus.cc:2932] T fec024e5ae7c43ebac0fb6f813701797 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.263921 13277 catalog_manager.cc:5484] T fec024e5ae7c43ebac0fb6f813701797 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.268289 13517 tablet_service.cc:1514] Processing DeleteTablet for tablet fec024e5ae7c43ebac0fb6f813701797 with delete_type TABLET_DATA_TOMBSTONED (TS 91066aa139a64459b70c70e9d02fe3e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40342
I20240503 14:13:03.268942 14260 tablet_replica.cc:330] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: stopping tablet replica
I20240503 14:13:03.269145 14260 raft_consensus.cc:2229] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:03.270656 14260 raft_consensus.cc:2258] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:03.271633 14260 ts_tablet_manager.cc:1875] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:03.276975 14260 ts_tablet_manager.cc:1888] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:03.277109 14260 log.cc:1196] T fec024e5ae7c43ebac0fb6f813701797 P 91066aa139a64459b70c70e9d02fe3e1: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/wals/fec024e5ae7c43ebac0fb6f813701797
I20240503 14:13:03.277753 13262 catalog_manager.cc:4830] TS 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): tablet fec024e5ae7c43ebac0fb6f813701797 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:03.289397 14204 raft_consensus.cc:1050] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:03.290084 14204 consensus_queue.cc:237] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.292335 13376 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.292335 13524 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.292520 14011 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.292959 14254 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.293255 14245 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.293514 14204 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.297833 14245 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.302651 13376 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.302659 13524 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.304278 13276 catalog_manager.cc:5484] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:03.312548 14011 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.316926 13450 consensus_queue.cc:237] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.319471 14011 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.319733 13376 raft_consensus.cc:1261] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 16559a1767cd4197b59673a1a99035a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.319905 14202 raft_consensus.cc:1050] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:03.319998 14204 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.320267 14245 consensus_queue.cc:1035] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.320569 14202 consensus_queue.cc:237] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.322917 14011 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.323439 13377 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.323189 14254 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.324103 13450 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.324190 14011 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.326503 14246 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.326764 13263 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 514eb3d2023740edb111da5cc6b6de35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:03.326987 14202 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.327908 14246 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.330613 13274 catalog_manager.cc:5484] T 514eb3d2023740edb111da5cc6b6de35 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New cstate: current_term: 1 leader_uuid: "16559a1767cd4197b59673a1a99035a8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:03.327528 13376 raft_consensus.cc:2932] T 514eb3d2023740edb111da5cc6b6de35 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.336843 13517 tablet_service.cc:1514] Processing DeleteTablet for tablet 514eb3d2023740edb111da5cc6b6de35 with delete_type TABLET_DATA_TOMBSTONED (TS 91066aa139a64459b70c70e9d02fe3e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40342
I20240503 14:13:03.337167 14260 tablet_replica.cc:330] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: stopping tablet replica
I20240503 14:13:03.337393 14260 raft_consensus.cc:2229] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:03.337646 14260 raft_consensus.cc:2258] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:03.338840 14260 ts_tablet_manager.cc:1875] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:03.345082 14260 ts_tablet_manager.cc:1888] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:03.345194 14260 log.cc:1196] T 514eb3d2023740edb111da5cc6b6de35 P 91066aa139a64459b70c70e9d02fe3e1: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-2-root/wals/514eb3d2023740edb111da5cc6b6de35
I20240503 14:13:03.345746 13262 catalog_manager.cc:4830] TS 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815): tablet 514eb3d2023740edb111da5cc6b6de35 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:03.349746 14137 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.350498 14010 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.354642 13277 catalog_manager.cc:5484] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.354977 13450 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.356616 13377 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.359737 13526 consensus_queue.cc:237] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.361610 14010 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.362128 14202 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.364388 13450 raft_consensus.cc:1261] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.364867 14202 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.365190 14010 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.366442 14137 consensus_queue.cc:1035] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20240503 14:13:03.369673 13262 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 03eaf58191a94b0ab4ef6ad226ca695a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:03.369035 13450 raft_consensus.cc:2932] T 03eaf58191a94b0ab4ef6ad226ca695a P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.371646 13277 catalog_manager.cc:5484] T 03eaf58191a94b0ab4ef6ad226ca695a P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index 3 to 4, VOTER 7fac721f53074af6930b046ab54bb83f (127.12.1.129) evicted. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:03.376435 13360 tablet_service.cc:1514] Processing DeleteTablet for tablet 03eaf58191a94b0ab4ef6ad226ca695a with delete_type TABLET_DATA_TOMBSTONED (TS 7fac721f53074af6930b046ab54bb83f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39580
I20240503 14:13:03.377462 14271 tablet_replica.cc:330] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: stopping tablet replica
I20240503 14:13:03.377607 14271 raft_consensus.cc:2229] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:03.377802 14271 raft_consensus.cc:2258] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:03.379707 14271 ts_tablet_manager.cc:1875] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:03.384457 14271 ts_tablet_manager.cc:1888] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:03.384559 14271 log.cc:1196] T 03eaf58191a94b0ab4ef6ad226ca695a P 7fac721f53074af6930b046ab54bb83f: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-0-root/wals/03eaf58191a94b0ab4ef6ad226ca695a
I20240503 14:13:03.385190 13263 catalog_manager.cc:4830] TS 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667): tablet 03eaf58191a94b0ab4ef6ad226ca695a (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:03.497664 14270 raft_consensus.cc:1050] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1: attempting to promote NON_VOTER eccadd5cf6154568b49f30afd9e746d2 to VOTER
I20240503 14:13:03.498484 14270 consensus_queue.cc:237] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.500480 14010 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 LEARNER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.500911 13377 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.500947 14202 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.501446 13450 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240503 14:13:03.501413 14267 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.502269 14202 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240503 14:13:03.514494 14267 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.518013 14011 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.518230 13377 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.519984 13277 catalog_manager.cc:5484] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240503 14:13:03.525729 13526 consensus_queue.cc:237] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } }
I20240503 14:13:03.527383 14011 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.527215 13450 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.527545 13377 raft_consensus.cc:1261] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240503 14:13:03.527945 14267 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.529307 14267 consensus_queue.cc:1035] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240503 14:13:03.532136 14202 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.535178 14011 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.535831 13377 raft_consensus.cc:2932] T eae4e983cf2042f7b03491e9dd3c38c9 P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.536388 13262 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet eae4e983cf2042f7b03491e9dd3c38c9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240503 14:13:03.540306 13274 catalog_manager.cc:5484] T eae4e983cf2042f7b03491e9dd3c38c9 P eccadd5cf6154568b49f30afd9e746d2 reported cstate change: config changed from index 3 to 4, VOTER 16559a1767cd4197b59673a1a99035a8 (127.12.1.130) evicted. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: false } } }
I20240503 14:13:03.544109 13436 tablet_service.cc:1514] Processing DeleteTablet for tablet eae4e983cf2042f7b03491e9dd3c38c9 with delete_type TABLET_DATA_TOMBSTONED (TS 16559a1767cd4197b59673a1a99035a8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58466
I20240503 14:13:03.544773 14276 tablet_replica.cc:330] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: stopping tablet replica
I20240503 14:13:03.545136 14276 raft_consensus.cc:2229] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240503 14:13:03.545384 14276 raft_consensus.cc:2258] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240503 14:13:03.545996 14276 ts_tablet_manager.cc:1875] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240503 14:13:03.550896 14276 ts_tablet_manager.cc:1888] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240503 14:13:03.550985 14276 log.cc:1196] T eae4e983cf2042f7b03491e9dd3c38c9 P 16559a1767cd4197b59673a1a99035a8: Deleting WAL directory at /tmp/dist-test-taskiE8rDO/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1714745515193609-12294-0/minicluster-data/ts-1-root/wals/eae4e983cf2042f7b03491e9dd3c38c9
I20240503 14:13:03.551558 13263 catalog_manager.cc:4830] TS 16559a1767cd4197b59673a1a99035a8 (127.12.1.130:43439): tablet eae4e983cf2042f7b03491e9dd3c38c9 (table test-workload [id=c57dc3732bcd441bbab0008ed3f8db3d]) successfully deleted
I20240503 14:13:04.559036 13526 consensus_queue.cc:237] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:04.561249 13377 raft_consensus.cc:1261] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:13:04.561276 13492 consensus_peers.cc:485] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f4aea14dec54042ab565a0bf2ec4a8b. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:04.561362 13453 raft_consensus.cc:1261] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:04.561792 14279 consensus_queue.cc:1035] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.562083 14202 consensus_queue.cc:1035] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.564822 14279 raft_consensus.cc:2932] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.565732 13453 raft_consensus.cc:2932] T 6f4aea14dec54042ab565a0bf2ec4a8b P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.565927 13377 raft_consensus.cc:2932] T 6f4aea14dec54042ab565a0bf2ec4a8b P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.571609 13277 catalog_manager.cc:5484] T 6f4aea14dec54042ab565a0bf2ec4a8b P 91066aa139a64459b70c70e9d02fe3e1 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:04.572443 13526 consensus_queue.cc:237] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:04.575987 13377 raft_consensus.cc:1261] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:13:04.576295 13492 consensus_peers.cc:485] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2b65a06703c4e309a69e11211909f8f. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:04.576671 14282 consensus_queue.cc:1035] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.576851 13453 raft_consensus.cc:1261] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 91066aa139a64459b70c70e9d02fe3e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:04.577505 14202 consensus_queue.cc:1035] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.580235 14270 raft_consensus.cc:2932] T b2b65a06703c4e309a69e11211909f8f P 91066aa139a64459b70c70e9d02fe3e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.581070 13377 raft_consensus.cc:2932] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.584112 13453 raft_consensus.cc:2932] T b2b65a06703c4e309a69e11211909f8f P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.588964 13274 catalog_manager.cc:5484] T b2b65a06703c4e309a69e11211909f8f P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "91066aa139a64459b70c70e9d02fe3e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } attrs { replace: true } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.590260 13377 consensus_queue.cc:237] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
W20240503 14:13:04.593616 13343 consensus_peers.cc:485] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8fb295127b54943a2971e2a30a59d74. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:04.593700 13453 raft_consensus.cc:1261] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:04.594425 14277 consensus_queue.cc:1035] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.595391 13526 raft_consensus.cc:1261] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:04.595846 14247 consensus_queue.cc:1035] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.597620 14247 raft_consensus.cc:2932] T b8fb295127b54943a2971e2a30a59d74 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.598126 13453 raft_consensus.cc:2932] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.602761 13277 catalog_manager.cc:5484] T b8fb295127b54943a2971e2a30a59d74 P 16559a1767cd4197b59673a1a99035a8 reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.603652 13526 raft_consensus.cc:2932] T b8fb295127b54943a2971e2a30a59d74 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.603977 13377 consensus_queue.cc:237] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } }
I20240503 14:13:04.609522 13453 raft_consensus.cc:1261] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240503 14:13:04.609921 13526 raft_consensus.cc:1261] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Refusing update from remote peer 7fac721f53074af6930b046ab54bb83f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240503 14:13:04.610229 13343 consensus_peers.cc:485] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f -> Peer eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132:38483): Couldn't send request to peer eccadd5cf6154568b49f30afd9e746d2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 560d40e7c91846f6a02539f867cb7431. This is attempt 1: this message will repeat every 5th retry.
I20240503 14:13:04.610630 14293 consensus_queue.cc:1035] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.611003 14247 consensus_queue.cc:1035] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240503 14:13:04.613905 14293 raft_consensus.cc:2932] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.614548 13526 raft_consensus.cc:2932] T 560d40e7c91846f6a02539f867cb7431 P 91066aa139a64459b70c70e9d02fe3e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.614709 13453 raft_consensus.cc:2932] T 560d40e7c91846f6a02539f867cb7431 P 16559a1767cd4197b59673a1a99035a8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } } }
I20240503 14:13:04.622237 13277 catalog_manager.cc:5484] T 560d40e7c91846f6a02539f867cb7431 P 7fac721f53074af6930b046ab54bb83f reported cstate change: config changed from index -1 to 2, NON_VOTER eccadd5cf6154568b49f30afd9e746d2 (127.12.1.132) added. New cstate: current_term: 1 leader_uuid: "7fac721f53074af6930b046ab54bb83f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "7fac721f53074af6930b046ab54bb83f" member_type: VOTER last_known_addr { host: "127.12.1.129" port: 38667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16559a1767cd4197b59673a1a99035a8" member_type: VOTER last_known_addr { host: "127.12.1.130" port: 43439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91066aa139a64459b70c70e9d02fe3e1" member_type: VOTER last_known_addr { host: "127.12.1.131" port: 34815 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eccadd5cf6154568b49f30afd9e746d2" member_type: NON_VOTER last_known_addr { host: "127.12.1.132" port: 38483 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240503 14:13:05.104611 14297 ts_tablet_manager.cc:902] T b2b65a06703c4e309a69e11211909f8f P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
F20240503 14:13:05.104947 14297 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (init.queue_time_us, init.queue_time_us) (init.run_cpu_time_us, init.run_cpu_time_us) (init.run_wall_time_us, init.run_wall_time_us) (leader-initialization.queue_time_us, leader-initialization.queue_time_us) (leader-initialization.run_cpu_time_us, leader-initialization.run_cpu_time_us) (leader-initialization.run_wall_time_us, leader-initialization.run_wall_time_us) (log-alloc.queue_time_us, log-alloc.queue_time_us) (log-alloc.run_cpu_time_us, log-alloc.run_cpu_time_us) (log-alloc.run_wall_time_us, log-alloc.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.queue_time_us, tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.queue_time_us) (tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.run_cpu_time_us, tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.run_cpu_time_us) (tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.run_wall_time_us, tablet-download-pool-03eaf58191a94b0ab4ef6ad226ca695a.run_wall_time_us) (tablet-download-pool-19240561f76443c4b24b30ead79fc478.queue_time_us, tablet-download-pool-19240561f76443c4b24b30ead79fc478.queue_time_us) (tablet-download-pool-19240561f76443c4b24b30ead79fc478.run_cpu_time_us, tablet-download-pool-19240561f76443c4b24b30ead79fc478.run_cpu_time_us) (tablet-download-pool-19240561f76443c4b24b30ead79fc478.run_wall_time_us, tablet-download-pool-19240561f76443c4b24b30ead79fc478.run_wall_time_us) (tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.queue_time_us, tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.queue_time_us) (tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.run_cpu_time_us, tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.run_cpu_time_us) (tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.run_wall_time_us, tablet-download-pool-514eb3d2023740edb111da5cc6b6de35.run_wall_time_us) (tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.queue_time_us, tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.queue_time_us) (tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.run_cpu_time_us, tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.run_cpu_time_us) (tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.run_wall_time_us, tablet-download-pool-6bdb73037ea74c09a4a1cdf983284299.run_wall_time_us) (tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.queue_time_us, tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.queue_time_us) (tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.run_cpu_time_us, tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.run_cpu_time_us) (tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.run_wall_time_us, tablet-download-pool-97f96b0aa5024991b4ad009c8c1393ec.run_wall_time_us) (tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.queue_time_us, tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.queue_time_us) (tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.run_cpu_time_us, tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.run_cpu_time_us) (tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.run_wall_time_us, tablet-download-pool-a21bd6acda964ddf87d770e3fdbe3789.run_wall_time_us) (tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.queue_time_us, tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.queue_time_us) (tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.run_cpu_time_us, tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.run_cpu_time_us) (tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.run_wall_time_us, tablet-download-pool-a5c8bbae71c641998f6f6171ad848075.run_wall_time_us) (tablet-download-pool-b2b65a06703c4e309a69e11211909f8f.queue_time_us, tablet-download-pool-b2b65a06703c4e309a69e11211909f8f.queue_time_us) (tablet-download-pool-dc278b18dbe543c797160688d0d08403.queue_time_us, tablet-download-pool-dc278b18dbe543c797160688d0d08403.queue_time_us) (tablet-download-pool-dc278b18dbe543c797160688d0d08403.run_cpu_time_us, tablet-download-pool-dc278b18dbe543c797160688d0d08403.run_cpu_time_us) (tablet-download-pool-dc278b18dbe543c797160688d0d08403.run_wall_time_us, tablet-download-pool-dc278b18dbe543c797160688d0d08403.run_wall_time_us) (tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.queue_time_us, tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.queue_time_us) (tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.run_cpu_time_us, tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.run_cpu_time_us) (tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.run_wall_time_us, tablet-download-pool-e32b84c7de40447b8d01baa8385c7817.run_wall_time_us) (tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.queue_time_us, tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.queue_time_us) (tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.run_cpu_time_us, tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.run_cpu_time_us) (tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.run_wall_time_us, tablet-download-pool-eae4e983cf2042f7b03491e9dd3c38c9.run_wall_time_us) (tablet-download-pool-ee5723bf5c86432d9320810b098874f2.queue_time_us, tablet-download-pool-ee5723bf5c86432d9320810b098874f2.queue_time_us) (tablet-download-pool-ee5723bf5c86432d9320810b098874f2.run_cpu_time_us, tablet-download-pool-ee5723bf5c86432d9320810b098874f2.run_cpu_time_us) (tablet-download-pool-ee5723bf5c86432d9320810b098874f2.run_wall_time_us, tablet-download-pool-ee5723bf5c86432d9320810b098874f2.run_wall_time_us) (tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.queue_time_us, tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.queue_time_us) (tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.run_cpu_time_us, tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.run_cpu_time_us) (tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.run_wall_time_us, tablet-download-pool-fec024e5ae7c43ebac0fb6f813701797.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us) (wal-append.queue_time_us, wal-append.queue_time_us) (wal-append.run_cpu_time_us, wal-append.run_cpu_time_us) (wal-append.run_wall_time_us, wal-append.run_wall_time_us)
*** Check failure stack trace: ***
*** Aborted at 1714745585 (unix time) try "date -d @1714745585" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800003006) received by PID 12294 (TID 0x7f33d967f700) from PID 12294; stack trace: ***
I20240503 14:13:05.114447 14298 ts_tablet_manager.cc:902] T 560d40e7c91846f6a02539f867cb7431 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667)
@ 0x7f34a7ada980 (unknown) at ??:0
@ 0x7f349ce27fb7 gsignal at ??:0
@ 0x7f349ce29921 abort at ??:0
@ 0x7f349f8dcdcd google::LogMessage::Fail() at ??:0
@ 0x7f349f8e0b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f349f8dc7cc google::LogMessage::Flush() at ??:0
@ 0x7f349f8ddf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f34a0f59742 kudu::TraceMetrics::InternName() at ??:0
I20240503 14:13:05.139380 14300 ts_tablet_manager.cc:902] T 6f4aea14dec54042ab565a0bf2ec4a8b P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 91066aa139a64459b70c70e9d02fe3e1 (127.12.1.131:34815)
@ 0x7f34a0f25f8b kudu::ThreadPool::ThreadPool() at ??:0
@ 0x7f34a0f1fcd6 kudu::ThreadPoolBuilder::Build() at ??:0
@ 0x7f34b03ec8de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7f34b0404daf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7f34b052f480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7f34b0567a8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7f34b054a981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
@ 0x7f34b054a70e std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f34b53ec98d std::function<>::operator()() at ??:0
@ 0x7f34a0f29b75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f34a0f2d19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f34a0f2d019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f34b53ec98d std::function<>::operator()() at ??:0
@ 0x7f34a0f0801e kudu::Thread::SuperviseThread() at ??:0
@ 0x7f34a7acf6db start_thread at ??:0
I20240503 14:13:05.209748 14317 ts_tablet_manager.cc:902] T b8fb295127b54943a2971e2a30a59d74 P eccadd5cf6154568b49f30afd9e746d2: Initiating tablet copy from peer 7fac721f53074af6930b046ab54bb83f (127.12.1.129:38667)
@ 0x7f349cf0a71f clone at ??:0